Lead Data Platform Engineer - AWS, Data Lakehouse, DataOps

ASX Limited; Australia; Hybrid; AUD 150.000 - 190.000; Vollzeit

Benefits dieser Stelle

Hybrid working

Flexible working arrangements

Zusammenfassung

ASX is seeking a senior Data Engineer to evolve and operate its end-to-end data platform. You will design data lake and data mesh architectures, build reusable tooling, and collaborate with architecture, product, and delivery teams to deliver scalable data solutions on AWS.

The role emphasises DataOps, CI/CD for data pipelines, and strong governance. Hybrid work options are available, with a focus on security and reliability in critical market infrastructure.

Qualifikationen

• 10+ years of data engineering experience.
• Proven track record designing and operating large-scale data platforms and pipelines in AWS.
• Experience with enterprise data pipeline tooling (Spark, dbt, Airflow).
• Deep expertise in distributed systems and modern data architectures.
• Knowledge of data lake, data warehouse and data lakehouse patterns.
• Experience with Terraform for data infrastructure automation.

Aufgaben

• Evolve end-to-end data platform design including ingestion, storage, transformation and serving layers.
• Lead data lake and data mesh architectures for scalability and cost efficiency.
• Design and maintain reusable frameworks, libraries and internal tooling for data pipelines.
• Engage stakeholders across architecture, product, delivery and business SMEs to ensure optimal data solutions.
• Ensure pipelines and processes adhere to engineering standards and compliance reporting.
• Drive DataOps adoption including CI/CD for data pipelines and IaC.

Kenntnisse

Data engineering

AWS cloud

Apache Spark

dbt

Airflow

Data pipelines

Data lakehouse

Terraform

JSON/Parquet/Avro/XML

Tools

Terraform

dbt

Airflow

Jobbeschreibung

ASX is seeking a senior Data Engineer to evolve and operate its end-to-end data platform. You will design data lake and data mesh architectures, build reusable tooling, and collaborate with architecture, product, and delivery teams to deliver scalable data solutions on AWS.

The role emphasises DataOps, CI/CD for data pipelines, and strong governance. Hybrid work options are available, with a focus on security and reliability in critical market infrastructure.