Data Migration Lead (Databricks)

Private Advertiser; Makati; On-site; PHP 900,000 - 1,500,000; Full time

Job summary

Private Advertiser seeks an experienced Data Engineer to drive cloud-based migration and data lake initiatives. You will work with Databricks and Spark to design and implement ETL/ELT pipelines, ensure data quality, and optimize lakehouse architectures.

The role requires strong SQL, Python, and PySpark skills, experience migrating data to Azure/AWS/GCP, and the ability to mentor junior engineers while coordinating with stakeholders.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or related field.
• 5–8 years of experience in data engineering, data migration, or ETL development.
• 3+ years of hands-on Databricks and Apache Spark experience.
• Strong proficiency in SQL, Python, and PySpark.
• Experience with Delta Lake, Databricks Workflows, and Unity Catalog.
• Strong knowledge of data lake/lakehouse architecture and Medallion architecture.
• Experience migrating data from legacy databases, data warehouses, files, or on-premise systems to cloud platforms.
• Experience with Azure, AWS, or GCP, preferably Azure.
• Knowledge of ETL/ELT, CDC, incremental loads, data mapping, reconciliation, and data validation.
• Experience with data quality, profiling, cleansing, and migration testing.
• Familiarity with Git, CI/CD, and DevOps practices.
• Ability to lead technical migration activities and mentor junior engineers.

Responsibilities

• Lead data migration initiatives and mentor junior engineers.
• Design and implement ETL/ELT pipelines in Databricks environment.
• Collaborate with stakeholders to ensure data quality and validation across platforms.

Skills

Data engineering

ETL development

Mentoring

Stakeholder management

Analytical thinking

Education

Bachelor's degree in Computer Science / IT / Engineering

Tools

Databricks

Apache Spark

Delta Lake

Unity Catalog

CI/CD / DevOps

Job description

Job description:

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or related field.

• 5–8 years of experience in data engineering, data migration, or ETL development.

• 3+ years of hands‑on Databricks and Apache Spark experience.

• Strong proficiency in SQL, Python, and PySpark.

• Experience with Delta Lake, Databricks Workflows, and Unity Catalog.

• Strong knowledge of data lake/lakehouse architecture and Medallion architecture.

• Experience migrating data from legacy databases, data warehouses, files, or on‑premise systems to cloud platforms.

• Experience with Azure, AWS, or GCP, preferably Azure.

• Knowledge of ETL/ELT, CDC, incremental loads, data mapping, reconciliation, and data validation.

• Experience with data quality, profiling, cleansing, and migration testing.

• Familiarity with Git, CI/CD, and DevOps practices.

• Ability to lead technical migration activities and mentor junior engineers.

• Strong analytical, problem-solving, communication, and stakeholder-management skills.

• Databricks certification is preferred.