Data Engineer: Real-Time Energy Data & AI Solutions

sggovterp; Singapore; On-site; SGD 70,000 - 130,000; Full time

Job summary

Energy Market Authority (Singapore) seeks a data engineering professional to architect and build the backbone of Singapore's energy data ecosystem. You will design end-to-end data processes, leverage Spark, and deploy cloud-native solutions across GovCloud and on-premises environments.

You will lead data quality, governance, and integration efforts while collaborating with agencies and partners to explore AI/ML technologies in the energy sector.

Qualifications

• Education in CS, data science, statistics, economics, or related disciplines with quantitative content.
• Experience in data engineering, data management, data analytics or ML projects; strong data/cloud technologies knowledge.
• Strong data modeling and data architecture skills for optimized analytic querying.
• Familiarity with Gen AI technologies would be advantageous.

Responsibilities

• Design, build, deploy, manage and maintain end-to-end data processes and data products including AI/ML models.
• Develop and maintain enterprise data lakes, analytics platforms and AI platforms on cloud/on-premise setups.
• Lead Agile project activities and act as product owner for data systems development, testing and maintenance.
• Develop scalable ETL processes for ingestion and integration of large, structured and unstructured data.
• Establish data quality, governance and compliance reporting for management and stakeholders.
• Collaborate with government agencies and industry partners to explore new AI/data technologies for EMA.

Skills

Python

SQL

Big data

SAS

R

Java/Scala

Data modeling

Gen AI / LLM

Education

Computer Science or related

Data Science/Statistics

Tools

AWS/Azure

S3/Blob Storage

ETL tools (Glue/Data Factory)

Redshift/Synapse

Job description

Energy Market Authority (Singapore) seeks a data engineering professional to architect and build the backbone of Singapore's energy data ecosystem. You will design end-to-end data processes, leverage Spark, and deploy cloud-native solutions across GovCloud and on-premises environments.

You will lead data quality, governance, and integration efforts while collaborating with agencies and partners to explore AI/ML technologies in the energy sector.