Senior Data Engineer

Focal Consulting; Kuala Lumpur; On-site; MYR 120,000 - 180,000; Full time

Benefits offered by this job

13th month salary

Annual bonus

Transport allowance

Housing subsidy

Job summary

Focal Consulting in Kuala Lumpur is seeking a data engineer to build scalable data pipelines and optimize data lake architectures for clean analytics data.

You will design batch and real-time ingestion, maintain data lake layers, and develop robust ETL/ELT workflows using Python, PySpark, and dbt, while monitoring data quality and optimizing performance and cost.

Qualifications

• 3–5+ years of hands-on experience in data engineering.
• Advanced proficiency in SQL and Python, with distributed processing experience (Spark/PySpark).
• Solid understanding of data modeling, data warehousing concepts, CDC methodologies, and message brokers.
• Ownership-driven with a strong engineering mindset to debug complex data flows.

Responsibilities

• Design, build, and maintain scalable batch and real-time data ingestion pipelines.
• Architect and maintain structured data lake layers (raw, staged, curated) and optimize storage and query performance.
• Develop robust ETL/ELT workflows using Python, PySpark, and dbt.
• Implement automated data validation, profiling, and monitoring for reliability and accuracy.
• Continuously optimize system performance, pipelines, and cost efficiency.

Tools

SQL

Python

Spark

PySpark

Airflow

Kafka

Data modeling

Data warehousing

Job description

Role Summary
Build scalable data pipelines, optimize data lake architectures, and deliver clean analytics data.

Roles & Responsibilities

• Pipeline Architecture:Design, build, and maintain scalable batch and real-time data ingestion pipelines using modern distributed frameworks.
• Data Lake & Warehousing:Architect and maintain structured data lake layers (raw, staged, curated) and optimize data storage and query performance.
• ETL/ELT Workflows:Develop robust data transformation and aggregation workflows using tools such as Python, PySpark, and dbt.
• Data Quality & Monitoring:Implement automated validation, data profiling, and proactive monitoring to ensure system reliability and data accuracy.
• Platform Optimization:Continuously optimize system performance, pipeline execution speed, and operational cost efficiency across data infrastructure.

Requirements

• Experience:3–5+ years of hands‑on experience in data engineering, building and maintaining production data platforms.
• Technical Skills:Advanced proficiency in SQL and Python, with hands‑on experience in distributed processing (e.g., Spark/PySpark) and orchestration tools (e.g., Airflow).
• Architecture & Data Systems:Solid understanding of data modeling, data warehousing concepts, CDC methodologies, and message brokers (e.g., Kafka).
• Candidate Profile:Ownership-driven with a strong engineering mindset, able to debug complex data flows and translate business needs into scalable pipelines.

Benefits

• 13-Month Salary:Guaranteed additional month of base salary.
• Yearly Performance Bonus:Rewarded annually based on individual and company achievements.
• Monthly Transport Allowance:Financial support to cover daily commuting expenses.
• Monthly Rental Subsidies:Monthly allowance provided to support your housing and accommodation needs.

Please note: Only shortlisted candidates will be notified.