Associate - Data Engineer

Ernst & Young Advisory Services Sdn Bhd; Kuala Lumpur; On-site; MYR 45,000 - 65,000; Full time

Job summary

A leading global consulting firm in Kuala Lumpur is seeking a Data Engineer to design and develop ETL pipelines for large-scale analytics. You will work directly with senior engineers to build data solutions, automate processes and ensure data availability. The ideal candidate has a background in IT or Data Engineering and familiarity with big data tools such as Apache Spark and cloud platforms.

Benefits

Flexible environment

Diversity and inclusion

Future-focused skills development

Qualifications

• Possess some experience as a Data Engineer or ETL Developer.
• Basic proficiency in SQL and at least one programming language (Python, Java, or Scala).

Responsibilities

• Design, develop ETL/ELT pipelines for structured, semi-structured, and unstructured data.
• Build data storage solutions (data lakes, warehouses, and streaming platforms).
• Implement data quality, validation, and monitoring processes.
• Optimize query performance and resource utilization in data processing systems.
• Collaborate with data scientists, ML engineers, and application developers to ensure seamless data availability.
• Automate workflows for data ingestion, transformation, and delivery.

Skills

Data Engineering

SQL

Python

Java

Scala

Education

Diploma/ Bachelor’s degree in Computer Science/ IT/ Machine Learning/ AI

Tools

Apache Spark

Hadoop

Informatica

Talend

Kafka

NiFi

Airflow

AWS Redshift

GCP BigQuery

Azure Synapse

Job description

The opportunity

We are seeking a professional looking to build a career in Data Engineering to design, build, and maintain robust data pipelines and architectures for large-scale analytics and AI workloads. You will work directly with Senior Data Engineers on data infrastructure, ensuring that data from multiple sources is efficiently collected, transformed, and made available for downstream applications. This role is fully hands-on and focused on technical execution

Your key responsibilities

To work under supervision of a Senior Data Engineer to deliver below task:

• Design, develop ETL/ELT pipelines for structured, semi-structured, and unstructured data.
• Build data storage solutions (data lakes, warehouses, and streaming platforms).
• Implement data quality, validation, and monitoring processes.
• Optimize query performance and resource utilization in data processing systems.
• Collaborate with data scientists, ML engineers, and application developers to ensure seamless data availability.
• Automate workflows for data ingestion, transformation, and delivery.

Skills and attributes for success

• Possess some experience as a Data Engineer or ETL Developer.
• Basic proficiency in SQL and at least one programming language (Python, Java, or Scala).

To qualify for the role, you must have

• Minimum qualifications of Diploma/ Bachelor’s degree in Computer Science/ IT/ Machine Learning/ AI.

Ideally, you’ll also have

• Experience with big data frameworks such as Apache Spark, Flink, or Hadoop.
• Proficiency with ETL tools (Informatica, Talend, Microsoft SSIS) or open-source integration tools (Kafka, NiFi, Airflow).
• Understanding of data modeling, warehousing concepts, and schema design.
• Familiarity with cloud data platforms (AWS Redshift, GCP BigQuery, Azure Synapse).
• Experience with streaming data processing and real-time analytics pipelines.

What we look for

• Knowledge of containerization (Docker, Kubernetes) for data workloads.
• Exposure to DevOps/DataOps practices for CI/CD of data pipelines.
• Experience with version control (Git) and infrastructure-as-code tools (Terraform).

What we offer you

At EY, we’ll develop you with future-focused skills and equip you with world-class experiences. We’ll empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. Learnmore .

Are you ready to shape your future with confidence? Apply today.

To help create the best experience during the recruitment process, please describe any disability-related adjustments or accommodations you may need.

EY| Building a better working world

EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets.

Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow.

EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories.

Select how often (in days) to receive an alert:

EY refers to the global organization, and may refer to one or more, of the member firms of Ernst & Young Global Limited, each of which is a separate legal entity. Ernst & Young Global Limited, a UK company limited by guarantee, does not provide services to clients.