Databricks Data Engineer — AWS Pipelines & ML

The Citco Group Limited; Makati; On-site; PHP 1,200,000 - 2,200,000; Full time

Benefits offered by this job

Flexible working arrangements

Training & education support

Job summary

Citco in Makati, Philippines, is seeking an IT Developer – Data Engineer to design, develop, and maintain ETL/ELT pipelines using Databricks Delta Lake and Apache Spark. The role focuses on migrating data assets to Databricks on AWS, building new data workflows, and ensuring data quality and governance across batch and streaming processing.

The ideal candidate has 3–5 years in data engineering with 2–3 years in Databricks, plus strong SQL, Python, and AWS integration skills.

Qualifications

• 3–5 years of hands-on data engineering experience, with at least 2–3 years dedicated to Databricks.
• Strong hands-on experience with Databricks core components.
• Proficiency in SQL, Python, PySpark, and/or Scala within Databricks.
• Experience integrating Databricks with AWS services including S3, AWS Glue, Athena, and Lambda.
• Hands-on experience building ETL/ELT jobs in AWS (Glue Jobs, Glue Crawlers, Data Catalog).
• Demonstrable experience in real-time and batch data processing using Databricks.
• Experience with PL/SQL programming, creating SQL scripts and stored procedures.
• Familiarity with BI Tools such as Power BI and/or QLIK.

Responsibilities

• Design, develop, and maintain ETL/ELT pipelines using Databricks Delta Lake and Apache Spark.
• Support data platform migration activities, migrating pipelines and data assets to Databricks on AWS.
• Assess, plan, and execute end-to-end migration strategies with minimal disruption and data integrity.
• Build and manage AWS-based data pipelines using AWS Glue, S3, and related ETL services.
• Implement data workflows using Databricks notebooks, jobs, and AWS Glue workflows.
• Create and optimize data models for both batch and streaming data processing.
• Develop and maintain data quality frameworks and monitoring during migration.
• Collaborate with cross-functional teams to understand data requirements and scalable solutions.
• Write efficient SQL queries and optimize performance.
• Implement data security and governance practices aligned with standards.
• Build and maintain documentation for data processes and architectures (Medallion Architecture).
• Explore Gen AI / Machine Learning capabilities on data pipelines where applicable.
• Stay current with new features of Databricks, AWS, and emerging data tools.
• Demonstrate flexibility to attend meetings across different time zones.

Skills

Databricks Core

SQL

Python

PySpark

Scala

AWS Services

ETL/ELT

Data Governance

Streaming

BI Tools

Education

Bachelor's degree

Tools

Databricks

AWS Glue

S3

Lambda

Delta Lake

Job description

Citco in Makati, Philippines, is seeking an IT Developer – Data Engineer to design, develop, and maintain ETL/ELT pipelines using Databricks Delta Lake and Apache Spark. The role focuses on migrating data assets to Databricks on AWS, building new data workflows, and ensuring data quality and governance across batch and streaming processing.

The ideal candidate has 3–5 years in data engineering with 2–3 years in Databricks, plus strong SQL, Python, and AWS integration skills.