Data Engineer jobs in Malaysia
Data Engineer
ITMAX SYSTEM BERHAD
Data Engineer: Spark, Kafka & Streaming Pipelines
Itmax System Berhad
Discover more opportunities than anywhere else. Find more jobs nowData Engineer
The Lifetime Value Company Costa Rica
Data Engineer
The Lifetime Value Co.
Data Engineer: Remote, Scalable Genealogy Pipelines
The Lifetime Value Company Costa Rica
Connect with headhunters to apply for similar jobsData Engineer - Real-Time Pipelines & ML Ops
Michael Page
Data Engineer: Spark, Kafka & On-Prem Pipelines
ITMAX SYSTEM BERHAD
Remote Data Engineer — Scalable Pipelines & APIs
The Lifetime Value Co.
Platform Data Engineer: Own a Production Data Platform
Itmax System Berhad
Senior Yield Analytics Engineer – Data-Driven Optimization
Intel
Senior Process Engineer: Data-Driven Process Optimizer
Winway Interconnect Technology (M)
Quality Analytics Engineer – Data-Driven Quality & SPC
Hirehub Management Sdn. Bhd.
Junior Data Engineer & Analytics Specialist
PPG
Senior/Lead Data Engineer (m/f/d)
Durr Dental
Data Engineer
Yayasan Peneraju Pendidikan Bumiputera (Yayasan Peneraju)
Data Engineer (Property)
Michael Page
Hybrid BI Engineer: Data Pipelines & Web Automation
Eternity Recruitment
Market Data Engineer
Royal Bank of Canada
Senior Data Engineer
Unravel Carbon
Data Engineer
Job summary
A leading data solutions provider in Kuala Lumpur is hiring a Data Engineer to design, build, and operate data pipelines on a modern platform. The role focuses on data ingestion and transformation, utilizing skills in Apache Spark and Kafka. Candidates should have strong programming capabilities and experience with SQL and relational databases. This position offers hands-on experience in a high-impact role within a small team, with opportunities for growth towards senior positions.
Benefits
Qualifications
- Strong programming skills in Python, Java, or Scala.
- Hands-on experience with Apache Spark for data processing.
- Working knowledge of messaging platforms like Apache Kafka.
- Strong SQL skills with experience in PostgreSQL or other RDBMS.
Responsibilities
- Design and operate large-scale batch processing pipelines.
- Develop ETL/ELT workflows for analytics and reporting.
- Implement data ingestion pipelines from various sources.
- Collaborate on deployment and reliability of data systems.
Skills
Tools
Add expected salary to your profile for insights
We are hiring a Data Engineer to design, build, and operate batch and event-driven data pipelines on a modern on-premise data platform.
This role focuses on data ingestion, transformation, and processing, using Apache Spark and Kafka, supporting analytics, reporting, and operational dashboards. You will work closely with Platform Integration Engineers, who manage the underlying infrastructure and streaming platform.
Apache Spark (SQL / PySpark / Structured Processing), Apache Kafka, Batch & Streaming Data Pipelines, ETL / ELT, CDC (Change Data Capture), PostgreSQL / Relational Databases, Docker / Kubernetes, Linux, On-Prem Data Platform
- Design, build, and operate large-scale batch processing pipelines using Apache Spark
- Develop ETL / ELT workflows for analytics and reporting
- Implement data ingestion pipelines from databases, APIs, and event sources
- Optimise data pipelines for performance, reliability, resource efficiency and data quality
- Consume and process events from Kafka
- Introduce streaming or near-real-time processing when required
- Work with CDC pipelines and event-based data sources
- Support schema evolution and downstream data consumption
- Collaborate with Platform Integration Engineers on deployment, observability, and reliability
- Work with backend and application teams on data requirements and integration
- Participate in troubleshooting data pipeline issues and performance bottlenecks
- Maintain documentation, data models, and design decisions
We do not expect every candidate to meet every requirement, but strong experience in most of the following is important.
- Strong programming skills in Python, Java, or Scala
- Hands-on experience with Apache Spark
- Working knowledge of Apache Kafka or other messaging platforms
- Strong SQL skills and experience with PostgreSQL or other RDBMS
- Familiarity with Linux environments
- Experience with Apache Flink, Spark Streaming, Kafka Streams
- Exposure to CDC tools (Debezium, Maxwell, GoldenGate)
- Experience with Docker and Kubernetes
- Familiarity with workflow orchestration tools (Airflow or similar)
- Experience with monitoring, CI/CD, or infrastructure-as-code tools
- Data Engineers who enjoy pipeline design and optimisation
- Backend engineers moving into data engineering
- Candidates interested in batch and streaming data systems
- Strong fundamentals with willingness to learn are welcome
- Ownership of core data pipelines in a production system
- Hands-on experience with Spark, Kafka, and distributed data systems
- Clear growth path toward Senior Data Engineer / Data Architect
- High-impact role in a small, engineering-focused team
* The salary benchmark is based on the target salaries of market leaders in their relevant sectors. It is intended to serve as a guide to help Premium Members assess open positions and to help in salary negotiations. The salary benchmark is not provided directly by the company, which could be significantly higher or lower.