Data Engineer (Data Engineering Branch)

Energy Market Authority; Singapore; Presencial; SGD 70.000 - 120.000; Jornada completa

Descripción de la vacante

Energy Market Authority seeks a data-centric professional to design, build and manage end-to-end data solutions, including AI/ML models, across cloud and on-premise environments. You will drive data governance, quality and analytics, partnering with government and industry to advance Singapore's energy landscape.

You will work on data lakes, real-time analytics, and scalable ETL processes, leveraging Spark and cloud-native services while coordinating with multi-stakeholder teams.

Formación

• Education in Computer Science, Data Science, Statistics, Economics, or related disciplines with substantial quantitative content.
• Experience in data engineering, data management, data analytics or ML projects; strong knowledge of data/cloud technologies.
• Strong foundation in data modeling techniques and data architecture for optimized analytical querying.
• Experience with AWS/Azure data services (e.g., S3/Blob Storage, Lambda/Functions, Glue/Data Factory, Redshift/Synapse).
• Fresh graduates are welcome to apply.
• Experience in data mining, machine learning, NLP, etc.
• Programming languages: SAS, R, Python, Java, or Scala for data science/processing.
• Knowledge of Gen AI technologies such as LLMs is advantageous.
• Excellent analytical, coordination and communication skills; strong problem-solving mindset.
• Strong interpersonal skills to engage and collaborate with stakeholders.

Responsabilidades

• Design, build, deploy, manage and maintain end-to-end data processes and data products; include AI/ML models on various platforms.
• Lead project and product owner activities for enterprise data systems using Agile methodology.
• Develop and implement scalable ETL processes for ingestion and integration from diverse sources (on-premise and cloud).
• Develop and maintain data quality, data governance and compliance reporting for management and stakeholders.
• Collaborate with business users, government agencies and partners to explore new data/AI technologies and deploy solutions.

Conocimientos

Data engineering

Data analytics

ML

Python

R

SAS

Java/Scala

Gen AI

Educación

Computer Science / Data Science / Statistics / Economics

Herramientas

AWS services

Azure services

S3/Blob Storage

Lambda/Functions

Glue/Data Factory

Redshift/Synapse

Descripción del empleo

What the role is:

You will leverage data modelling and engineering techniques, statistics, data technologies and cloud computing platforms to develop integrated, innovative data-driven solutions which will support and advance EMA's core work and strategic goals against the backdrop of an evolving energy landscape. You will architect the backbone of Singapore's energy data ecosystem and leverage distributed computing frameworks (Spark) and cloud-native services to build robust data lakes and real-time streaming analytics.

What you will be working on:

The key responsibilities of the officer include:

• Design, build, deploy, manage and maintain end-to-end data processes, data products and related solutions such as AI/ML models and simulation models; on a variety of data platforms on the Government Commercial Cloud as well as on-premise setups;
• Perform project management and product owner activities for the development, testing and maintenance of enterprise data systems such as data lakes, analytics platforms and AI platforms according to the Agile methodology;
• Develop and implement scalable and reliable Extract, Transform and Load (ETL) processes for the ingestion and integration of large, structured and unstructured data from a variety of data sources. This includes systems that are on-premise and cloud platforms;
• Develop and maintain robust data quality processes, data management frameworks and implement data governance policies to meet compliance and governance requirements. Conduct regular data quality audits and generate reports on these for management and senior stakeholders; and
• Working with business users, project teams, government agencies, international organizations and industry partners to explore new AI/ML and data technologies, tools and techniques in the energy sector; and identify new deployable solutions to support and advance EMA's core work and strategic goals;

What we are looking for:

Requirements

• Education in Computer Science, Data Science, Statistics, Economics, or other related disciplines with substantial quantitative content.
• Relevant working experience, especially in handling data engineering, data management, data analytics or ML projects; as well as strong knowledge of data/cloud technologies.
• A strong foundation in data modeling techniques and data architecting for optimized analytical querying is required.
• Experience with AWS/Azure data related services (e.g., S3/Blob Storage, Lambda/Functions, Glue/Data Factory, and Redshift/Synapse) will be advantageous.
• Fresh graduates are also welcome to apply.
• Demonstrable experience in leveraging data/ML techniques such as data mining, data engineering, machine learning, natural language processing, etc.
• Demonstrable experience in programming languages like SAS, R, Python, Java, or Scala for data science and/or data processing applications.
• Knowledge/experience in working with Gen AI technologies such as LLM models would be an advantage.
• Excellent analytical, coordination and communication (written and verbal) skills are critical for this position.
• Applicants must possess an independent problem-solving mindset with a strong desire to find innovative and 'out of the box' solutions to problems.
• Applicants must possess strong interpersonal skills to engage, collaborate, build and maintain relationships with stakeholders.
• Applicant must be a committed team player, with a strong interest to shape Singapore's energy landscape and public service.

About Energy Market Authority

The Energy Market Authority (EMA) is statutory board under the Singapore Ministry of Trade and Industry (MTI). Through our work, we seek to build a clean energy future that is resilient, sustainable and competitive. We aim to ensure a reliable and secure energy supply, promote effective competition in the energy market and develop a dynamic energy sector in Singapore.At EMA, we are dedicated to fostering a culture of innovation, collaboration, continuous learning and employee well-being. Joining us means embarking on a meaningful career where you will be part of a transformative journey towards a clean energy future, experiencing a unique adventure of discovery and growth.We empower our people to drive innovation at every level Our open culture encourages teams to embrace diverse perspectives, enabling you to push beyond the status quo We are committed to energising your growth through ample opportunities for skill development. helping you become an expert in your field and a valuable asset to the energy industry.You also stand to enjoy a comprehensive suite of benefits which are designed to meet your needs and prioritise your holistic well-being.Visit: www.ema.gov.sg for more information.