Data Engineer: Cloud-Native Pipelines & Data Warehousing

Blue Data Digital SDN BHD; Kuala Lumpur; On-site; MYR 120,000 - 180,000; Full time

Job summary

Blue Data Digital SDN BHD in Kuala Lumpur is seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines and platforms. You will own end-to-end data flows, from ingestion to modeling and delivery, enabling analytics, BI, and AI/ML initiatives across the organization.

The ideal candidate has hands-on Python and SQL expertise, strong data modeling knowledge, and the ability to architect solutions on cloud platforms (GCP preferred).

Qualifications

• Bachelor's degree in a relevant field (CS/IT/Data Science).
• Strong Python and SQL skills with hands-on data engineering experience.
• Experience building batch and real-time data pipelines.
• Familiarity with data warehousing concepts and data modeling.

Responsibilities

• Design, build, and maintain scalable batch and real-time data pipelines using ETL/ELT patterns.
• Ingest and integrate structured, semi-structured, and unstructured data from diverse sources.
• Implement incremental loading, CDC, and idempotent pipeline design.
• Design and optimize data models for analytics and reporting.
• Build and manage data warehouses and lakehouses (BigQuery, Cloud Storage).
• Orchestrate workflows using Cloud Composer, Dagster, Prefect, or similar tools.
• Implement data validation and quality checks (Great Expectations, dbt tests, Soda, Dataplex).
• Monitor, troubleshoot, and optimize pipelines for performance and cost.
• Collaborate with analytics, BI, AI/ML, and software teams to meet business needs.

Skills

Python

SQL

Data modeling

ETL/ELT

Cloud platforms

Data pipelines

Education

Bachelor's degree in Computer Science or related field

Tools

Cloud Composer

Dagster

Prefect

dbt

Soda

Dataplex

BigQuery

Cloud Storage

Job description

Blue Data Digital SDN BHD in Kuala Lumpur is seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines and platforms. You will own end-to-end data flows, from ingestion to modeling and delivery, enabling analytics, BI, and AI/ML initiatives across the organization.

The ideal candidate has hands-on Python and SQL expertise, strong data modeling knowledge, and the ability to architect solutions on cloud platforms (GCP preferred).