Senior Data Engineer

Ørsted; Kuala Lumpur; On-site; MYR 90,000 - 150,000; Full time

Job summary

Ørsted Data Ecosystem is seeking an adept data engineer to join a global team responsible for building and maintaining data ingestion pipelines and platform capabilities. You will contribute to data governance, security, and scalable processing, enabling data-driven decisions across the organisation.

You will collaborate with data engineers, architects, and stakeholders to optimize pipelines, while applying Spark, SQL, Python, and cloud technologies in a modern cloud environment.

Qualifications

• Have professional data engineering experience in data analytics, data processing tools, ETL, ELT etc.
• Have strong hands-on Python and SQL skills with DevOps and CI/CD (GitHub Actions, Azure DevOps etc.) knowledge.
• Have experience working with Spark/PySpark, Kafka or NiFi.
• Are familiar with cloud platforms (AWS, Azure) and container technology (Kubernetes, Docker).
• Have an experimental mindset and appreciate learning new things.
• Are curious and engaged with a passion for making a difference through data.

Responsibilities

• Developing and maintaining production-grade and peer-reviewed data ingestion pipelines.
• Ensuring that data is made available in a way that is optimised for security, stability, and performance.
• Collaborating with peer data engineers, architects and other stakeholders to identify and solve problems within data engineering practices.
• Participating in developing the capabilities and governance of the data platform.
• Setting up monitoring and orchestration of data pipelines.

Skills

Python

SQL

DevOps CI/CD

Spark/PySpark

Kafka

NiFi

Data analytics

Tools

AWS

Azure

Kubernetes

Docker

GitHub Actions

Azure DevOps

Job description

Join us in this role whereyou’llperform both development and internal support tasks in a team of data enthusiasts who are passionate about developingplatformsolutions that enable data driven decisions throughout the organisation.

Welcome to Ørsted Data Ecosystem

You’ll be part of a global team where you, together with your colleagues, will deliver value to the business across Orsted.You’llbe a central part of our team evolving, developing, andmaintainingthe data engineering and ingestion pipelines within Ørsted Data Ecosystem.

The Ørsted Data Ecosystem is a modern cloud-based dataplatformproviding technology that supports the collection, processing, and consumption of data from all Ørsted’ s business units, using batch or streaming patterns and making it available to analysts, data scientists, and machine learning models. When working with our backlog, we aim to empower people to make decisions, we promote collaboration between people and teams, and we provide work hour flexibility.

You’ll play an important role in:

• developing and maintaining production-grade and peer-reviewed data ingestion pipelines
• ensuring that data is made available in a way that is optimised for security, stability, and performance
• collaborating with the peer data engineers, architects and other stakeholders to identify and solve problems within data engineering practices
• participating in developing the capabilities and governance of the data platform
• setting up monitoring and orchestration of data pipelines.

To succeed in the role, you:

• have professional data engineering experience in data analytics, data processing tools, ETL, ELT etc
• have strong hands-on Python and SQL skills with DevOps and CI/CD (GitHub Actions, Azure DevOps etc.) knowledge
• have experience working with Spark/PySpark, Kafka or NiFi
• are familiar with cloud platforms (AWS, Azure) and container technology (Kubernetes, Docker)
• have an experimental mindset and appreciate learning new things
• are curious and engaged with a passion for making a difference through data.

Maybe you’veread the above and can see you have some transferable skills, even though theydon’tquite match all the points.

Shape the future with us

As an applicant or employee, you may request reasonable work and position accommodation or adjustments via [e-mail].