Data Engineer — Databricks & AWS for Global Analytics

Public Service Division; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

Singapore Economic Development Board’s Singapore Global Network seeks a Data Engineer to design and maintain scalable data pipelines using Databricks and AWS. You will implement medallion data architectures, governance via Unity Catalog, and ML-ready datasets for analytics.

You will collaborate with stakeholders to translate data requirements into robust, compliant data solutions, ensuring data quality and reliable BI-ready outputs.

Qualifications

• 2-5 years data engineering experience, capable of independent data pipeline work.
• Diploma or degree in Computer Science, Engineering, IT, or Data Science.
• Proficiency with Databricks including workflows, notebooks, and cluster management.
• Experience implementing medallion architecture for data lake solutions.
• Hands-on with Unity Catalog for data governance and cataloguing.
• Strong Python and SQL for data manipulation.
• Experience with Jupyter notebooks and collaborative data science environments.
• Working knowledge of AWS data services (S3, Athena, RDS).
• Understanding ETL/ELT principles and data pipeline design patterns.
• Basic knowledge of ML concepts and ML pipeline implementation.
• Singaporean or PR.

Responsibilities

• Design and implement data pipelines using Databricks workflows and notebooks.
• Build and maintain medallion architecture (Bronze, Silver, Gold) for data processing.
• Develop ETL processes to integrate data from SaaS platforms and internal systems.
• Implement data governance using Unity Catalog for discovery, lineage, and access control.
• Create and maintain Jupyter notebooks for exploration and analytics.
• Design scalable data storage using AWS services (S3, RDS, Athena).
• Build data models and prepare datasets for reporting and BI.
• Implement ML pipelines for basic predictive analytics and insights.
• Ensure data quality, validation, and monitoring across workflows.
• Collaborate with stakeholders to understand data requirements and deliver analytics-ready datasets.

Skills

Python

SQL

Databricks

Unity Catalog

Jupyter

ETL/ELT

AWS

Data governance

Education

Diploma or degree in Computer Science/Engineering/IT/Data Science

Tools

Databricks

Unity Catalog

Jupyter

AWS (S3, Athena, RDS)

Job description

Singapore Economic Development Board’s Singapore Global Network seeks a Data Engineer to design and maintain scalable data pipelines using Databricks and AWS. You will implement medallion data architectures, governance via Unity Catalog, and ML-ready datasets for analytics.

You will collaborate with stakeholders to translate data requirements into robust, compliant data solutions, ensuring data quality and reliable BI-ready outputs.