Senior Data Engineer — Cloud Data Pipelines & Lakehouse

Experian; Kuala Lumpur; Hybrid; MYR 180,000 - 240,000; Full time

Benefits offered by this job

Hybrid work

Inclusive paid leave

People-first workplace

Paid Internship

Job summary

Experian Malaysia is seeking a talented Data Engineer to join the Ascend Sandbox team, helping scale a cloud-based analytical platform across the APAC region. You will build and optimize data pipelines, model data products for analytics, and collaborate with internal and client teams to deliver reliable, governed data processing.

The role emphasizes Python and PySpark development, SQL proficiency, and AWS services.

Qualifications

• Degree in Computer Science, Data Engineering or equivalent.
• 6+ years of data engineering experience with data pipelines.
• Proficient in Python and PySpark for large-scale processing.
• Strong SQL skills and performance tuning.
• Experience with AWS data services and data governance is a plus.

Responsibilities

• Design, build, test, deploy and operate scalable data pipelines (batch and streaming).
• Develop Python, PySpark, and SQL solutions for large datasets.
• Design data models and reusable datasets for analytics and data science.
• Optimize AWS-based data solutions (S3, Glue, Athena, Redshift, EMR).
• Implement data governance, metadata, lineage and security requirements.
• Collaborate with clients and teams to translate requirements into solutions.

Skills

Python

PySpark

SQL

AWS

Airflow

Data Pipelines

Education

Bachelor's degree in CS/Data Eng

Tools

AWS

S3

Glue

Redshift

EMR

MWAA

Job description

Experian Malaysia is seeking a talented Data Engineer to join the Ascend Sandbox team, helping scale a cloud-based analytical platform across the APAC region. You will build and optimize data pipelines, model data products for analytics, and collaborate with internal and client teams to deliver reliable, governed data processing.

The role emphasizes Python and PySpark development, SQL proficiency, and AWS services.