Lead Data Engineer - Dagster Architect & ELT Leader

BonusLink

Petaling Jaya

On-site

MYR 180,000 - 240,000

Full time

10 days ago

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

BonusLink seeks a Senior Data Engineer to lead a lean data team spanning BI, Data Science, and Data Engineering. You will be the most senior voice in Data Engineering, influence architecture, and mentor a junior DE while collaborating with an Analytics Engineer who handles transformation layers above your pipelines.

You will work across AWS and GCP in a Medallion architecture, owning ingestion reliability, data contracts, and platform scalability.

Qualifications

5+ years of hands-on data engineering, with at least 2 years in senior/lead capacity.
Strong Python and advanced SQL skills (CTEs, window functions, performance).
Production experience with Dagster or Airflow; migration willingness.
Hands-on AWS and/or GCP experience (Athena, S3, Glue, Lambda, BigQuery, Pub/Sub).
Proven track record building ELT pipelines at scale (millions of events/day).
Working knowledge of dbt and data modelling (star/snowflake, Medallion layers).
DataOps fundamentals: Git, CI/CD, monitoring, alerting, observability.
Mentor junior engineers and set engineering standards.

Responsibilities

Design and maintain scalable ELT pipelines ingesting millions of events monthly across AWS and GCP.
Lead orchestration of production pipelines in Dagster; migrate legacy Airflow workflows.
Own pipeline monitoring, incidents, data quality, and SLA management across ingestion.
Set engineering standards and DataOps practices (CI/CD, testing, documentation).
Mentor the existing Data Engineer through reviews and pairing.
Understand how pipelines feed dbt models and contribute to Bronze-layer sources.
Optimize query performance and control storage costs for Athena and BigQuery.
Collaborate with Analytics, Data Science, and product teams to translate requirements into reliable data foundations.