Data Engineer - AWS

Michael Page; Kuala Lumpur; Hybrid; MYR 60,000 - 90,000; Full time

Job summary

A large organization in the energy sector is seeking a Data Engineer in Kuala Lumpur. Responsibilities include designing data pipelines and ensuring data integrity with AWS services. The ideal candidate will have strong skills in data lake architectures and PySpark. This role offers a hybrid working arrangement and the opportunity to work on large-scale global projects with cross-functional teams.

Benefits

Medical Benefits

Opportunity to work with latest technologies

Opportunity to work on large scale projects

Qualifications

• Expert-level fluency in AWS services relevant to data engineering.
• Strong problem-solving skills and attention to detail.
• Ability to work independently and manage tasks effectively.

Responsibilities

• Design, develop, and maintain data pipelines and ETL workflows using AWS services.
• Work with large datasets to ensure data integrity, scalability, and performance.
• Support migration efforts to Databricks and optimize workflows for performance.

Skills

Data lake architectures

Big data technologies

Data pipeline orchestration

AWS services

PySpark

Advanced SQL

CI/CD practices

Education

AWS Certification (Data Analytics - Specialty or Solutions Architect)

Tools

Databricks

Job description

Responsibilities

• Design, develop, and maintain data pipelines and ETL workflows using AWS services.
• Implement orchestration and automation for data workflows.
• Work with large datasets to ensure data integrity, scalability, and performance.
• Collaborate with stakeholders to understand data requirements and deliver solutions.
• Deploy changes directly to production environments with confidence and accountability.
• Support migration efforts to Databricks and optimize workflows for performance.

Qualifications

• Experience with data lake architectures, big data technologies, and data pipeline orchestration.
• Familiarity with CI/CD practices for data engineering.
• AWS Certification (e.g., AWS Certified Data Analytics - Specialty or Solutions Architect) is a plus.
• Strong problem-solving skills and attention to detail.
• Expert-level fluency in AWS services relevant to data engineering, including Glue, S3, Lambda, Step Functions, and other related services.
• Strong proficiency in PySpark for distributed data processing.
• Advanced SQL skills for querying and optimizing data operations.
• Comfortable with pushing changes live without formal review, ensuring quality through self-validation.
• Databricks experience is a plus.
• Ability to work independently and manage tasks in a siloed environment.

The employer is a large organization within the energy and natural resources industry, offering a professional environment and opportunities for technological innovation. The company is committed to leveraging advanced data solutions to improve its operations and services.

Opportunity to work on large scale global projects. Opportunity to work with international cross functional teams.

Benefits

• Contract: 1 year (extendable)
• Medical Benefits
• Hybrid Working Arrangement
• Opportunities to work with the latest technologies in the industry.
• Opportunity to work on large scale project with big international teams

This is an excellent opportunity for a Data Engineer based in Kuala Lumpur to contribute to impactful projects within the energy and natural resources industry. Apply now!