Senior Data Platform Engineer - Spark, dbt, Airflow (AWS)

ASX

Sydney

Hybrid

AUD 150,000 - 210,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

ASX is seeking an experienced Lead Data Engineer to shape and operate Australia’s premier data platforms. You will design end-to-end data pipelines, data lake/data mesh architectures and reusable tooling across teams. The role requires deep AWS expertise, distributed systems knowledge and strong stakeholder engagement.

10+ years in data engineering and a track record of delivering large-scale platforms, with DataOps, Terraform and Airflow experience. Hybrid work arrangement offered in Australia.

Qualifications

  • Extensive experience architecting and operating large-scale data platforms in AWS.
  • Proven ability to lead data engineering teams and programs.
  • Strong knowledge of data lake, data warehouse and lakehouse patterns.
  • Experience with distributed systems and modern data architectures.

Responsibilities

  • Lead end-to-end data platform design including ingestion, storage, transformation and serving layers.
  • Design data lake and data mesh architectures with scalability and cost efficiency.
  • Build reusable frameworks and tooling to accelerate data pipeline development.
  • Stakeholder engagement across architecture, product, delivery and SMEs to ensure optimal data solutions.
  • Ensure compliance, data privacy and governance across platforms.

Skills

AWS
Data engineering
Data lakes
SQL
Python
ETL/ELT
Spark
Terraform
Airflow
Data governance

Tools

dbt
Apache Airflow
Terraform
Snowflake

Job description

ASX is seeking an experienced Lead Data Engineer to shape and operate Australia’s premier data platforms. You will design end-to-end data pipelines, data lake/data mesh architectures and reusable tooling across teams. The role requires deep AWS expertise, distributed systems knowledge and strong stakeholder engagement.

10+ years in data engineering and a track record of delivering large-scale platforms, with DataOps, Terraform and Airflow experience. Hybrid work arrangement offered in Australia.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer, AWS & Real-Time Platform (Hybrid Sydney)
Data Engineer, AWS & Real-Time Platform (Hybrid Sydney)

ASX Limited • Sydney

Hybrid
AUD 180,000 - 240,000
Hybrid working
Flexible working arrangements
Senior Data Engineer: AWS, Spark, Hadoop & Airflow
Senior Data Engineer: AWS, Spark, Hadoop & Airflow

Maltem Australia • Sydney

Hybrid
AUD 150,000 - 190,000
Flexible working practices
Ongoing training and development
Career progression discussions
Senior Data Engineer
Senior Data Engineer

CareCone Group • Sydney

On-site
AUD 140,000 - 190,000
Lead Data Platform Engineer - AWS, Data Lakehouse, DataOps
Lead Data Platform Engineer - AWS, Data Lakehouse, DataOps

ASX Limited • Australia

Hybrid
AUD 150,000 - 190,000
Hybrid working
Flexible working arrangements
Senior Data Engineer — AWS, Glue & Airflow
Senior Data Engineer — AWS, Glue & Airflow

M&T Resources • Sydney

On-site
AUD 150,000 - 210,000
Principal Data Engineer (Apache Spark, dbt, Airflow)
Principal Data Engineer (Apache Spark, dbt, Airflow)

ASX • Sydney

Hybrid
AUD 150,000 - 210,000
Senior Data Engineer — AWS Data Pipelines & Spark Expert
Senior Data Engineer — AWS Data Pipelines & Spark Expert

CareCone Group • Sydney

On-site
AUD 140,000 - 190,000
AWS Data Engineer
AWS Data Engineer

CareCone Group • Sydney

On-site
AUD 110,000 - 160,000
Senior Azure Data Engineer
Senior Azure Data Engineer

Umbrella Club • Sydney

On-site
AUD 140,000 - 200,000
Senior AWS Data Engineer: Scalable Pipelines & Analytics
Senior AWS Data Engineer: Scalable Pipelines & Analytics

AUSDX PTY LTD • Sydney

On-site
AUD 140,000 - 200,000