Data Engineer: Build Scalable ETL Pipelines & Data Models

Private Advertiser; Ampang Jaya; On-site; MYR 90,000 - 130,000; Full time

Job summary

Private Advertiser in Malaysia seeks a Data Engineer to own end-to-end data architecture, from ingestion to governance. You will design data models, automate workflows, and promote reproducibility, partnering with analysts and stakeholders.

This startup-like environment emphasizes building scalable storage, ETL/ELT pipelines, and tooling choices across cloud platforms. You will refactor Python workflows, implement quality checks, and help set data governance standards organization-wide.

Qualifications

• Strong proficiency in Python (pandas, PySpark, or similar libraries for data processing).
• Solid understanding of SQL and experience with relational databases.
• Hands-on experience designing or maintaining ETL pipelines and workflow orchestration tools (Airflow, Prefect, Luigi).
• Good grasp of data modeling, schema design, and data governance principles.
• Experience handling large datasets and optimizing data performance.
• Comfortable working in environments with minimal existing infrastructure and building systems from scratch.
• Strong analytical thinking, problem-solving skills, and ability to work with both technical and non-technical stakeholders.

Responsibilities

• Design, build, and maintain ETL/ELT pipelines for automated data ingestion, transformation, and validation.
• Establish a centralized data storage system, starting with lightweight solutions and scaling toward cloud-based infrastructure.
• Collaborate with analysts and business teams to translate reporting needs into scalable, reusable data models.
• Implement data quality checks, logging, and monitoring to ensure reliability and transparency of data flows.
• Refactor existing Python/Jupyter workflows into structured, production-ready codebases.
• Evaluate and recommend tools for data warehousing, orchestration, and cloud migration.
• Define and promote best practices in version control, documentation, and reproducibility.

Skills

Python

SQL

ETL pipelines

data modeling

data governance

large datasets

stakeholders

Tools

Airflow

Prefect

Luigi

Docker

Snowflake

BigQuery

Redshift

Databricks

Power BI

Tableau

Job description

Private Advertiser in Malaysia seeks a Data Engineer to own end-to-end data architecture, from ingestion to governance. You will design data models, automate workflows, and promote reproducibility, partnering with analysts and stakeholders.

This startup-like environment emphasizes building scalable storage, ETL/ELT pipelines, and tooling choices across cloud platforms. You will refactor Python workflows, implement quality checks, and help set data governance standards organization-wide.