Data Engineer: Scale ETL Pipelines on Databricks & AWS

Salmon Group; Taguig; On-site; PHP 1,500,000 - 2,000,000; Full time

Job summary

Salmon Group is seeking a skilled Data Engineer to join their growing data platform team in Taguig, Philippines. The role involves building and scaling infrastructure for data-driven decisions, including designing robust pipelines and collaborating with various teams.

The ideal candidate will have extensive experience with Databricks, Apache Spark, and AWS, focusing on end-to-end pipeline development and optimizing data flows from source to insight.

Qualifications

• Hands-on experience with Databricks.
• Strong proficiency in Apache Spark (PySpark and/or Scala).
• Good command of Spark SQL and performance optimization techniques.
• Proficiency in Python for data engineering.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines using Databricks (Apache Spark).
• Develop and maintain data lake/lakehouse architectures using AWS S3, Delta Lake, and Databricks.
• Implement batch and streaming data ingestion from multiple sources.
• Optimize Spark jobs for performance and cost.

Skills

Databricks

Apache Spark

AWS

Python

SQL

Git

Problem-solving

Analytical Thinking

Tools

Delta Lake

PySpark

Job description

Salmon Group is seeking a skilled Data Engineer to join their growing data platform team in Taguig, Philippines. The role involves building and scaling infrastructure for data-driven decisions, including designing robust pipelines and collaborating with various teams.

The ideal candidate will have extensive experience with Databricks, Apache Spark, and AWS, focusing on end-to-end pipeline development and optimizing data flows from source to insight.