Senior Data Engineer - Scalable Pipelines & Data Lakes

Jdynamic Resources; Kuala Lumpur; In loco; MYR 98.000 - 150.000; Tempo pieno

Vantaggi offerti da questo lavoro

13-Month Salary

Yearly Performance Bonus

Monthly Transport Allowance

Monthly Rental Subsidies

Descrizione del lavoro

Jdynamic Resources is seeking a data engineer to design and optimize scalable data pipelines and data lake architectures in Kuala Lumpur. You will deliver clean analytics data and support ongoing data infrastructure improvements.

Ideal candidates have 3–5+ years in data engineering, strong SQL/Python skills, and hands-on Spark/PySpark and Airflow experience to drive reliable ETL/ELT workflows and data quality monitoring.

Competenze

• 3–5+ years of hands-on data engineering experience building production data platforms.
• Advanced proficiency in SQL and Python with distributed processing experience.
• Solid understanding of data modeling and data warehousing concepts; aware of CDC methods.
• Experience with distributed processing frameworks (Spark/PySpark) and orchestration tools (Airflow).

Mansioni

• Design, build, and maintain scalable batch and real-time data ingestion pipelines.
• Architect and maintain structured data lake layers (raw, staged, curated).
• Develop robust ETL/ELT workflows using Python, PySpark, and dbt.
• Implement automated data validation, profiling, and monitoring for reliability.

Conoscenze

SQL

Python

Data modeling

Data warehousing

CDC

Kafka

Spark/PySpark

Airflow

Strumenti

Spark/PySpark

Airflow

Kafka

Descrizione del lavoro

Jdynamic Resources is seeking a data engineer to design and optimize scalable data pipelines and data lake architectures in Kuala Lumpur. You will deliver clean analytics data and support ongoing data infrastructure improvements.

Ideal candidates have 3–5+ years in data engineering, strong SQL/Python skills, and hands-on Spark/PySpark and Airflow experience to drive reliable ETL/ELT workflows and data quality monitoring.