Senior Data Engineer: Cloud Pipelines & Platform

Ørsted; Kuala Lumpur; On-site; MYR 90,000 - 150,000; Full time

Job summary

Ørsted Data Ecosystem is seeking an adept data engineer to join a global team responsible for building and maintaining data ingestion pipelines and platform capabilities. You will contribute to data governance, security, and scalable processing, enabling data-driven decisions across the organisation.

You will collaborate with data engineers, architects, and stakeholders to optimize pipelines, while applying Spark, SQL, Python, and cloud technologies in a modern cloud environment.

Qualifications

• Have professional data engineering experience in data analytics, data processing tools, ETL, ELT etc.
• Have strong hands-on Python and SQL skills with DevOps and CI/CD (GitHub Actions, Azure DevOps etc.) knowledge.
• Have experience working with Spark/PySpark, Kafka or NiFi.
• Are familiar with cloud platforms (AWS, Azure) and container technology (Kubernetes, Docker).
• Have an experimental mindset and appreciate learning new things.
• Are curious and engaged with a passion for making a difference through data.

Responsibilities

• Developing and maintaining production-grade and peer-reviewed data ingestion pipelines.
• Ensuring that data is made available in a way that is optimised for security, stability, and performance.
• Collaborating with peer data engineers, architects and other stakeholders to identify and solve problems within data engineering practices.
• Participating in developing the capabilities and governance of the data platform.
• Setting up monitoring and orchestration of data pipelines.

Skills

Python

SQL

DevOps CI/CD

Spark/PySpark

Kafka

NiFi

Data analytics

Tools

AWS

Azure

Kubernetes

Docker

GitHub Actions

Azure DevOps

Job description

Ørsted Data Ecosystem is seeking an adept data engineer to join a global team responsible for building and maintaining data ingestion pipelines and platform capabilities. You will contribute to data governance, security, and scalable processing, enabling data-driven decisions across the organisation.

You will collaborate with data engineers, architects, and stakeholders to optimize pipelines, while applying Spark, SQL, Python, and cloud technologies in a modern cloud environment.