Principal Data Platform Engineer – Public Service

Public Service Division; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

Public Service Division in Singapore is seeking a data engineer to design, build and operate secure, scalable data platforms and pipelines supporting regulatory, operational, analytics and AI needs. You will transform diverse energy-sector data into trusted data products to improve availability, quality and insight.

The role covers batch and near-real-time pipelines, cloud and on-prem environments, data lakes and warehouses, ETL/ELT components, data governance and cost control, with

Qualifications

• Degree in Computer Science/Information Systems/Engineering or equivalent practical experience.
• Hands-on data engineering experience; internships/projects may count for entry level.
• Strong proficiency in SQL and at least one general-purpose programming language (Python/Java/Scala).
• Understanding of ETL/ELT design, data modelling, relational and non-relational databases, data warehousing, data lakes or lakehouse.
• Experience with data services on AWS or Microsoft Azure; advantageous.
• Knowledge of distributed data processing or streaming tech (Spark, PySpark, Kafka) is advantageous.
• Knowledge of data quality, metadata, lineage, access control, privacy and governance.
• Strong analytical and problem-solving skills; good written and verbal communication.

Responsibilities

• Design, build, test, deploy and maintain robust data pipelines ingesting structured, semi-structured and unstructured data from internal and external sources.
• Build and enhance cloud and on-premises data platforms including data lakes, lakehouses, data warehouses and curated layers.
• Develop reusable ETL/ELT components, data models and transformation logic.
• Implement automated data validation, monitoring, lineage and alerting for data products.
• Optimise pipeline performance, storage, compute, and query efficiency with cost controls.
• Apply software engineering practices: version control, code reviews, CI/CD, tests, and documentation.
• Monitor production data workflows, troubleshoot failures and perform root-cause analysis for reliability.
• Collaborate with business users, system owners, analysts, data scientists and agencies to translate data requirements.
• Contribute to EMA’s data engineering standards and reusable patterns.

Skills

SQL

Python

Java

Scala

ETL/ELT

Data modelling

Data warehousing

AWS

Azure

Spark

Education

BSc/BE in Computer Science / Information Systems / Engineering

Tools

Apache Spark

Kafka

PySpark

Job description

Public Service Division in Singapore is seeking a data engineer to design, build and operate secure, scalable data platforms and pipelines supporting regulatory, operational, analytics and AI needs. You will transform diverse energy-sector data into trusted data products to improve availability, quality and insight.

The role covers batch and near-real-time pipelines, cloud and on-prem environments, data lakes and warehouses, ETL/ELT components, data governance and cost control, with