IT.Developer - Data Engineer

The Citco Group Limited; Makati; On-site; PHP 900,000 - 1,500,000; Full time

Benefits offered by this job

Flexible working arrangements

Training and education support

Diversity and inclusion

Job summary

The Citco Group Limited in Makati, Philippines is seeking an IT Developer – Data Engineer to design, build, and optimize Databricks-based data pipelines on AWS. You will migrate legacy pipelines, ensure data integrity, and collaborate across teams to deliver scalable data solutions.

You will work with SQL, Python, PySpark, and Spark in a governance-focused environment, leveraging Delta Lake, Unity Catalog, and Data Quality frameworks.

Qualifications

• 3–5 years in data engineering with 2–3 years on Databricks platforms.
• Proficient in SQL, Python, PySpark, and possibly Scala within Databricks.
• Experience integrating Databricks with AWS (S3, Glue, Lambda).
• Knowledge of Delta Lake, Delta Live Tables, Unity Catalog, and data governance.

Responsibilities

• Design, develop, and maintain ETL/ELT pipelines on Databricks Delta Lake and Spark.
• Lead migration of pipelines and data assets to Databricks on AWS.
• Build and optimize AWS-based data pipelines using Glue, S3, and related tools.
• Develop data models for batch and streaming processing.
• Implement data quality frameworks and monitoring during migrations.
• Collaborate with cross-functional teams to meet data requirements.
• Write efficient SQL queries and optimize performance.
• Apply data security and governance practices per standards.
• Document data processes and architectures (Medallion Architecture).
• Explore Gen AI/ML capabilities within data pipelines where applicable.

Skills

SQL

Python

PySpark

Scala

Databricks experience

Education

Bachelor's degree or equivalent experience

Tools

Databricks Delta Lake

Apache Spark

Unity Catalog

Delta Live Tables

Databricks Workflows

Job Orchestration

AWS Glue

S3

Lambda

Structured Streaming

Power BI

QLIK

SQL

Job description

JOB DESCRIPTION

Armed with superior services, smart people, and strong technology, we tackle our customers’ complicated challenges by developing sophisticated solutions driven directly by their demands. The result? Innovation that generates tangible value and makes a real difference for our clients and their companies.

About Citco

Armed with superior services, smart people, and strong technology, we tackle our customers’ complicated challenges by developing sophisticated solutions driven directly by their demands. The result? Innovation that generates tangible value and makes a real difference for our clients and their companies.

IT Developer – Data Engineer

Makati, Philippines

About The Team & Business Line

Proprietary software solutions and innovation are at the core of what differentiates Citco in the alternative investment space. Through our network of global development centers, Citco invests heavily in technology development, security, and infrastructure to ensure our clients continue to receive award-winning products that underpin our commitment to service excellence.

As a core member of our Innovation Development team, you will work with dedicated professionals to ensure our clients maintain access to their critical information assets while keeping Citco ahead of industry trends.

Your Role

• Design, develop, and maintain ETL/ELT pipelines using Databricks Delta Lake and Apache Spark
• Support data platform migration activities, including migrating pipelines, workflows, and data assets from legacy or alternative platforms (e.g., on-premise, other cloud platforms) to Databricks on AWS
• Assess, plan, and execute end-to-end migration strategies ensuring minimal disruption and data integrity throughout
• Build and manage AWS-based data pipelines using AWS Glue, S3, and related ETL services
• Implement data workflows using Databricks notebooks, jobs, and AWS Glue workflows
• Create and optimize data models for both batch and streaming data processing
• Develop and maintain data quality frameworks and monitoring systems during and post-migration
• Collaborate with cross-functional teams to understand data requirements and implement scalable solutions
• Write efficient SQL queries and optimize performance of existing queries
• Implement data security and governance practices aligned with organizational standards
• Build and maintain documentation for data processes, migration runbooks, and architectures (e.g., Medallion Architecture)
• Explore and apply Gen AI / Machine Learning capabilities on data pipelines where applicable
• Stay current with new and upcoming features of Databricks, AWS, and emerging data tools
• Demonstrate flexibility to attend meetings across different time zones, with openness to varying schedules based on business needs

About You

Experience and Technical Skills

• 3–5 years of hands‑on experience in data engineering, with at least 2–3 years of dedicated Databricks hands‑on experience including notebooks, clusters, jobs, Delta Live Tables, and Unity Catalog
• Strong hands‑on experience with Databricks core components:
  • Delta Lake & Delta Live Tables (DLT)
  • Databricks Workflows & Job Orchestration
  • Unity Catalog & Data Governance
  • Databricks AutoLoader & Structured Streaming
• In‑depth knowledge of SQL, Python, PySpark, and/or Scala within the Databricks environment
• Strong expertise integrating Databricks with AWS services including S3, AWS Glue, Athena, and Lambda
• Hands‑on experience building and managing ETL/ELT jobs in AWS (Glue Jobs, Glue Crawlers, Glue Data Catalog)
• Demonstrable experience in real‑time and batch data processing using Databricks
• Experience with PL/SQL programming, creating SQL scripts and writing stored procedures
  • Familiarity with BI Tools such as Power BI and/or QLIK

Education

• Bachelors' degree or equivalent experience
• Demonstrated commitment to continuous improvement and training

Desired Skills And Expertise

• Databricks Data Science/Engineer certifications
• PowerBI, Predictive Analytics, AI/ML, Medallion architecture
• Exposure to or working knowledge of Generative AI, LLMs, or Machine Learning in a data context (e.g., MLflow, feature stores, model serving) — nice to have

Our Benefits

• Your wellbeing is of paramount importance to us, and central to our success. We provide a range of benefits, training and education support, and flexible working arrangements to help you achieve success in your career while balancing personal needs. Ask us about specific benefits in your location.
• We recognize diversity as a source of organizational pride and strength. We have made it a priority to reflect our nation’s evolving diversity in the people we hire, and the culture we create in our organization.
• Citco welcomes and encourages applications from people with disabilities. Accommodations are available upon request for candidates taking part in all aspects of the selection.

QUALIFICATIONS

Our Benefits

• Your wellbeing is of paramount importance to us, and central to our success. We provide a range of benefits, training and education support, and flexible working arrangements to help you achieve success in your career while balancing personal needs. Ask us about specific benefits in your location.
• We embrace diversity, prioritizing the hiring of people from diverse backgrounds. Our inclusive culture is a source of pride and strength, fostering innovation and mutual respect.
• Citco welcomes and encourages applications from people with disabilities. Accommodations are available upon request for candidates taking part in all aspects of the selection.