Data Engineer (Data Engineering Branch)

sggovterp; Singapore; On-site; SGD 70,000 - 130,000; Full time

Job summary

Energy Market Authority (Singapore) seeks a data engineering professional to architect and build the backbone of Singapore's energy data ecosystem. You will design end-to-end data processes, leverage Spark, and deploy cloud-native solutions across GovCloud and on-premises environments.

You will lead data quality, governance, and integration efforts while collaborating with agencies and partners to explore AI/ML technologies in the energy sector.

Qualifications

• Education in CS, data science, statistics, economics, or related disciplines with quantitative content.
• Experience in data engineering, data management, data analytics or ML projects; strong data/cloud technologies knowledge.
• Strong data modeling and data architecture skills for optimized analytic querying.
• Familiarity with Gen AI technologies would be advantageous.

Responsibilities

• Design, build, deploy, manage and maintain end-to-end data processes and data products including AI/ML models.
• Develop and maintain enterprise data lakes, analytics platforms and AI platforms on cloud/on-premise setups.
• Lead Agile project activities and act as product owner for data systems development, testing and maintenance.
• Develop scalable ETL processes for ingestion and integration of large, structured and unstructured data.
• Establish data quality, governance and compliance reporting for management and stakeholders.
• Collaborate with government agencies and industry partners to explore new AI/data technologies for EMA.

Skills

Python

SQL

Big data

SAS

R

Java/Scala

Data modeling

Gen AI / LLM

Education

Computer Science or related

Data Science/Statistics

Tools

AWS/Azure

S3/Blob Storage

ETL tools (Glue/Data Factory)

Redshift/Synapse

Job description

[What the role is]

You will leverage data modelling and engineering techniques, statistics, data technologies and cloud computing platforms to develop integrated, innovative data-driven solutions which will support and advance EMA's core work and strategic goals against the backdrop of an evolving energy landscape. You will architect the backbone of Singapore's energy data ecosystem and leverage distributed computing frameworks (Spark) and cloud-native services to build robust data lakes and real-time streaming analytics.

[What you will be working on]

The key responsibilities of the officer include: Design, build, deploy, manage and maintain end-to-end data processes, data products and related solutions such as AI/ML models and simulation models; on a variety of data platforms on the Government Commercial Cloud as well as on-premise setups; Perform project management and product owner activities for the development, testing and maintenance of enterprise data systems such as data lakes, analytics platforms and AI platforms according to the Agile methodology; Develop and implement scalable and reliable Extract, Transform and Load (ETL) processes for the ingestion and integration of large, structured and unstructured data from a variety of data sources. This includes systems that are on-premise and cloud platforms; Develop and maintain robust data quality processes, data management frameworks and implement data governance policies to meet compliance and governance requirements. Conduct regular data quality audits and generate reports on these for management and senior stakeholders; and Working with business users, project teams, government agencies, international organizations and industry partners to explore new AI/ML and data technologies, tools and techniques in the energy sector; and identify new deployable solutions to support and advance EMA's core work and strategic goals;

[What we are looking for]

Requirements

• Education in Computer Science, Data Science, Statistics, Economics, or other related disciplines with substantial quantitative content.


• Relevant working experience, especially in handling data engineering, data management, data analytics or ML projects; as well as strong knowledge of data/cloud technologies.


• A strong foundation in data modeling techniques and data architecting for optimized analytical querying is required.


• Experience with AWS/Azure data related services (e.g., S3/Blob Storage, Lambda/Functions, Glue/Data Factory, and Redshift/Synapse) will be advantageous.


• Fresh graduates are also welcome to apply.


• Demonstrable experience in leveraging data/ML techniques such as data mining, data engineering, machine learning, natural language processing, etc.


• Demonstrable experience in programming languages like SAS, R, Python, Java, or Scala for data science and/or data processing applications.


• Knowledge/experience in working with Gen AI technologies such as LLM models would be an advantage.


• Excellent analytical, coordination and communication (written and verbal) skills are critical for this position.


• Applicants must possess an independent problem-solving mindset with a strong desire to find innovative and 'out of the box' solutions to problems.


• Applicants must possess strong interpersonal skills to engage, collaborate, build and maintain relationships with stakeholders.


• Applicant must be a committed team player, with a strong interest to shape Singapore's energy landscape and public service.