Data Engineer — Databricks, AWS, Pipelines & Governance

Public Service Division; Singapore; On-site; SGD 70,000 - 120,000; Full time

Job summary

The Public Service Division invites applications for a Data Engineer to join SGN’s digital products team in Singapore. You will design and maintain end-to-end data pipelines, leveraging Databricks and AWS to deliver analytics-ready datasets and governance.

You will work on medallion architecture, ML pipelines, and BI-ready data models, collaborating with stakeholders across government partners.

Qualifications

• 2-5 years of data engineering experience, able to work independently on data pipeline projects.
• Proficiency with Databricks platform including workflows, notebooks and cluster management.
• Experience implementing medallion architecture for data lake solutions.
• Hands-on experience with Unity Catalog for data governance and cataloguing.
• Strong Python and SQL skills for data manipulation and transformation.
• Experience with Jupyter notebooks and collaborative data science environments.
• Working knowledge of AWS data services (S3, Athena, RDS).
• Understanding of ETL/ELT principles and data pipeline design patterns.
• Basic knowledge of machine learning concepts and ML pipeline implementation.
• Singaporean or PR.

Responsibilities

• Design and implement data pipelines using Databricks workflows and notebooks.
• Build and maintain medallion architecture (Bronze, Silver, Gold) for data processing and transformation.
• Develop ETL/ELT processes to integrate data from various SaaS platforms and internal systems.
• Implement data governance practices using Unity Catalog for data discovery, lineage, and access control.
• Create and maintain Jupyter notebooks for data exploration and collaborative analytics.
• Design scalable data storage solutions using AWS services (S3, RDS, Athena).
• Build data models and prepare datasets optimised for reporting and business intelligence.
• Implement ML pipelines for basic predictive analytics and data insights.
• Ensure data quality, validation, and monitoring across all data workflows.
• Collaborate with stakeholders to understand data requirements and deliver analytics-ready datasets.

Education

Diploma or degree in Computer Science, Engineering, Information Technology, Data Science or related disciplines

Tools

Databricks

Python

SQL

Jupyter notebooks

AWS data services

S3

RDS

Athena

Unity Catalog

Job description

The Public Service Division invites applications for a Data Engineer to join SGN’s digital products team in Singapore. You will design and maintain end-to-end data pipelines, leveraging Databricks and AWS to deliver analytics-ready datasets and governance.

You will work on medallion architecture, ML pipelines, and BI-ready data models, collaborating with stakeholders across government partners.