Principal Data Platform Engineer - Energy & Analytics

Singapore Public Service; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

Singapore Public Service through EMA seeks a data platform engineer to design, build and operate secure, scalable data pipelines and platforms across cloud and on‑premises environments. You will transform diverse energy-sector data into trusted data products to improve availability and time-to-insight.

The role requires hands-on data engineering, SQL proficiency, and experience with Python/Java/Scala, plus experience with AWS or Azure.

Qualifications

• Degree in Computer Science, Information Systems, Engineering or a related technical discipline, or equivalent practical experience.
• Hands-on experience in data engineering, data integration, data platform development or a related field.
• Strong proficiency in SQL and at least one general-purpose programming language, preferably Python, Java or Scala.
• Sound understanding of ETL/ELT design, data modelling, relational and non-relational databases, data warehousing, data lakes or lakehouse architectures.
• Experience with data services on AWS or Microsoft Azure, such as object storage, serverless compute, orchestration, data integration, distributed processing and analytical databases.
• Knowledge of distributed data processing or streaming technologies, such as Apache Spark, PySpark or Kafka.
• Knowledge of data quality, metadata management, lineage, access control, privacy and data governance principles.
• Strong analytical and problem-solving skills, with the ability to diagnose complex data issues and develop pragmatic, sustainable solutions.
• Good written and verbal communication skills, with the ability to collaborate effectively across technical and business teams.
• A committed team player with a strong interest in public service and in shaping Singapore’s energy future.

Responsibilities

• Design, build and operate robust batch and near-real-time data pipelines ingesting data from internal and external sources.
• Build and enhance cloud and on-premises data platforms, including data lakes, lakehouses, data warehouses and curated data layers.
• Develop ETL/ELT components, data models and transformation logic using SQL and languages like Python, Java or Scala.
• Implement automated data validation, lineage, monitoring and alerting to ensure accuracy and timeliness of data products.
• Optimise pipeline performance, storage, compute utilisation and query efficiency while managing service levels and costs.
• Apply software engineering practices including version control, code reviews, automated testing, CI/CD, documentation and configuration management.
• Monitor production workflows, troubleshoot failures, perform root-cause analysis and drive continuous improvements.
• Collaborate with business users, system owners and partners to translate data requirements into secure, scalable engineering solutions.
• Contribute to technical standards and reusable engineering patterns to improve EMA’s data engineering capabilities.

Skills

SQL

Python

Java

Scala

ETL/ELT

Data modelling

Data warehousing

Data lakes

Spark

Kafka

AWS

Azure

Data governance

Problem solving

Communication

Education

Bachelor's degree or equivalent

Tools

AWS

Azure

Spark

Kafka

Job description

Singapore Public Service through EMA seeks a data platform engineer to design, build and operate secure, scalable data pipelines and platforms across cloud and on‑premises environments. You will transform diverse energy-sector data into trusted data products to improve availability and time-to-insight.

The role requires hands-on data engineering, SQL proficiency, and experience with Python/Java/Scala, plus experience with AWS or Azure.