Senior Data Engineer

Jdynamic Resources; Kuala Lumpur; On-site; MYR 98,000 - 150,000; Full time

Benefits offered by this job

13-Month Salary

Yearly Performance Bonus

Monthly Transport Allowance

Monthly Rental Subsidies

Job summary

Jdynamic Resources is seeking a data engineer to design and optimize scalable data pipelines and data lake architectures in Kuala Lumpur. You will deliver clean analytics data and support ongoing data infrastructure improvements.

Ideal candidates have 3–5+ years in data engineering, strong SQL/Python skills, and hands-on Spark/PySpark and Airflow experience to drive reliable ETL/ELT workflows and data quality monitoring.

Qualifications

• 3–5+ years of hands-on data engineering experience building production data platforms.
• Advanced proficiency in SQL and Python with distributed processing experience.
• Solid understanding of data modeling and data warehousing concepts; aware of CDC methods.
• Experience with distributed processing frameworks (Spark/PySpark) and orchestration tools (Airflow).

Responsibilities

• Design, build, and maintain scalable batch and real-time data ingestion pipelines.
• Architect and maintain structured data lake layers (raw, staged, curated).
• Develop robust ETL/ELT workflows using Python, PySpark, and dbt.
• Implement automated data validation, profiling, and monitoring for reliability.

Skills

SQL

Python

Data modeling

Data warehousing

CDC

Kafka

Spark/PySpark

Airflow

Tools

Spark/PySpark

Airflow

Kafka

Job description

Role Summary

Build scalable data pipelines, optimize data lake architectures, and deliver clean analytics data.

Roles & Responsibilities

• Pipeline Architecture:Design, build, and maintain scalable batch and real-time data ingestion pipelines using modern distributed frameworks.
• Data Lake & Warehousing:Architect and maintain structured data lake layers (raw, staged, curated) and optimize data storage and query performance.
• ETL/ELT Workflows:Develop robust data transformation and aggregation workflows using tools such as Python, PySpark, and dbt.
• Data Quality & Monitoring:Implement automated validation, data profiling, and proactive monitoring to ensure system reliability and data accuracy.
• Platform Optimization:Continuously optimize system performance, pipeline execution speed, and operational cost efficiency across data infrastructure.

Requirements

• Experience:3–5+ years of hands-on experience in data engineering, building and maintaining production data platforms.
• Technical Skills:Advanced proficiency in SQL and Python, with hands-on experience in distributed processing (e.g., Spark/PySpark) and orchestration tools (e.g., Airflow).
• Architecture & Data Systems:Solid understanding of data modeling, data warehousing concepts, CDC methodologies, and message brokers (e.g., Kafka).
• Candidate Profile:Ownership-driven with a strong engineering mindset, able to debug complex data flows and translate business needs into scalable pipelines.

Benefits

• 13-Month Salary:Guaranteed additional month of base salary.
• Yearly Performance Bonus:Rewarded annually based on individual and company achievements.
• Monthly Transport Allowance:Financial support to cover daily commuting expenses.
• Monthly Rental Subsidies:Monthly allowance provided to support your housing and accommodation needs.

Additional information

• 13-Month Salary & Yearly Performance Bonus
• Monthly Transport Allowance
• Monthly Rental Subsidies