Data Engineer – ETL Pipelines on Databricks/AWS

Citco; Philippines; On-site; PHP 900,000 - 1,500,000; Full time

Job summary

Citco in Makati, Philippines seeks an IT Developer – Data Engineer to design, develop, and maintain ETL/ELT pipelines using Databricks Delta Lake and Apache Spark. You will migrate data assets to Databricks on AWS, build AWS-based pipelines, and implement data quality and governance, collaborating across teams.

A strong background in SQL, Python, PySpark, and Databricks, with 3–5 years of experience, is required. This is a full-time, on-site role in a dynamic global fintech environment.

Qualifications

• 3–5 years of hands-on data engineering experience, with at least 2–3 years on Databricks including notebooks, clusters, jobs, and Delta features.
• Strong hands-on Databricks core components knowledge: Delta Lake, DLT, Workflows, Unity Catalog, AutoLoader, Structured Streaming.
• Proficiency with SQL, Python, PySpark, or Scala within Databricks.
• Experience integrating Databricks with AWS services (S3, Glue, Athena, Lambda).
• Hands-on experience building ETL/ELT jobs in AWS (Glue Jobs/Crawlers/Data Catalog).
• Experience with real-time and batch data processing using Databricks.
• PL/SQL knowledge and creating SQL scripts with stored procedures.
• Familiarity with BI tools such as Power BI and/or Qlik.

Responsibilities

• Design, develop, and maintain ETL/ELT pipelines using Databricks Delta Lake and Apache Spark
• Support data platform migration activities, migrating pipelines and data assets to Databricks on AWS
• Assess, plan, and execute end-to-end migration strategies with data integrity
• Build and manage AWS-based data pipelines using AWS Glue, S3, and related ETL services
• Implement data workflows using Databricks notebooks, jobs, and AWS Glue workflows
• Create and optimize data models for batch and streaming data processing
• Develop and maintain data quality frameworks and monitoring during and after migration
• Collaborate with cross-functional teams to capture data requirements and scale solutions
• Write efficient SQL queries and optimize performance of existing queries
• Implement data security and governance practices per standards
• Build and maintain runbooks and architectures documentation (e.g., Medallion Architecture)
• Explore and apply Gen AI / ML capabilities on data pipelines where applicable
• Stay current with features of Databricks, AWS, and emerging data tools
• Attend meetings across time zones as needed to support business needs

Skills

SQL

Python

PySpark

Scala

Databricks

AWS services

ETL/ELT design

Real-time data processing

Data governance

Data visualization

Education

Bachelor's degree or equivalent experience

Tools

Databricks Delta Lake

Delta Live Tables

Unity Catalog

AWS Glue

S3

Athena

Lambda

Power BI

Qlik

Databricks Workflows

Job description

Citco in Makati, Philippines seeks an IT Developer – Data Engineer to design, develop, and maintain ETL/ELT pipelines using Databricks Delta Lake and Apache Spark. You will migrate data assets to Databricks on AWS, build AWS-based pipelines, and implement data quality and governance, collaborating across teams.

A strong background in SQL, Python, PySpark, and Databricks, with 3–5 years of experience, is required. This is a full-time, on-site role in a dynamic global fintech environment.