Data Engineer (Data Engineering Branch)

Energy Market Authority (EMA); Singapore; In loco; SGD 70.000 - 110.000; Tempo pieno

Descrizione del lavoro

Energy Market Authority (EMA) in Singapore seeks a data-focused professional to architect Singapore's energy data ecosystem. You will leverage data modelling, cloud platforms and distributed computing (Spark) to build data lakes and real-time analytics, aligning with EMA's strategic goals.

You will design end-to-end data processes, develop ETL and data governance, and collaborate with government partners to explore AI/ML technologies in the energy sector.

Competenze

• Education in CS, DS, Stats, Economics with quantitative content.
• Experience in data engineering, data analytics or ML projects; strong data/cloud knowledge.
• Strong foundation in data modelling and data architecture for optimized analytics.
• Experience with AWS/Azure data services or similar cloud platforms preferred.
• Familiarity with Gen AI tech like LLMs advantageous.

Mansioni

• Design, build, deploy, manage end-to-end data processes and data products.
• Manage development, testing and maintenance of enterprise data systems per Agile.
• Develop scalable ETL processes for ingesting data from diverse sources (on-prem and cloud).
• Maintain data quality, governance and reporting for management stakeholders.
• Collaborate with business users and partners to explore AI/ML data tech and solutions.

Conoscenze

Data modelling

Data engineering

Statistical analysis

Cloud technologies

AI/ML techniques

Programming languages

Problem solving

Communication

Formazione

Computer Science

Data Science

Statistics

Economics

Strumenti

Python

R

SAS

Java

Scala

Descrizione del lavoro

[What the role is]

You will leverage data modelling and engineering techniques, statistics, data technologies and cloud computing platforms to develop integrated, innovative data-driven solutions which will support and advance EMA's core work and strategic goals against the backdrop of an evolving energy landscape. You will architect the backbone of Singapore's energy data ecosystem and leverage distributed computing frameworks (Spark) and cloud-native services to build robust data lakes and real-time streaming analytics.

[What you will be working on]

The key responsibilities of the officer include:

• Design, build, deploy, manage and maintain end-to-end data processes, data products and related solutions such as AI/ML models and simulation models; on a variety of data platforms on the Government Commercial Cloud as well as on-premise setups;
• Perform project management and product owner activities for the development, testing and maintenance of enterprise data systems such as data lakes, analytics platforms and AI platforms according to the Agile methodology;
• Develop and implement scalable and reliable Extract, Transform and Load (ETL) processes for the ingestion and integration of large, structured and unstructured data from a variety of data sources. This includes systems that are on-premise and cloud platforms;
• Develop and maintain robust data quality processes, data management frameworks and implement data governance policies to meet compliance and governance requirements. Conduct regular data quality audits and generate reports on these for management and senior stakeholders; and
• Working with business users, project teams, government agencies, international organizations and industry partners to explore new AI/ML and data technologies, tools and techniques in the energy sector; and identify new deployable solutions to support and advance EMA's core work and strategic goals;

[What we are looking for]

Requirements

• Education in Computer Science, Data Science, Statistics, Economics, or other related disciplines with substantial quantitative content.
• Relevant working experience, especially in handling data engineering, data management, data analytics or ML projects; as well as strong knowledge of data/cloud technologies.
• A strong foundation in data modeling techniques and data architecting for optimized analytical querying is required.
• Experience with AWS/Azure data related services (e.g., S3/Blob Storage, Lambda/Functions, Glue/Data Factory, and Redshift/Synapse) will be advantageous.
• Fresh graduates are also welcome to apply.
• Demonstrable experience in leveraging data/ML techniques such as data mining, data engineering, machine learning, natural language processing, etc.
• Demonstrable experience in programming languages like SAS, R, Python, Java, or Scala for data science and/or data processing applications.
• Knowledge/experience in working with Gen AI technologies such as LLM models would be an advantage.
• Excellent analytical, coordination and communication (written and verbal) skills are critical for this position.
• Applicants must possess an independent problem-solving mindset with a strong desire to find innovative and 'out of the box' solutions to problems.
• Applicants must possess strong interpersonal skills to engage, collaborate, build and maintain relationships with stakeholders.
• Applicant must be a committed team player, with a strong interest to shape Singapore's energy landscape and public service.