Data Engineer AWS - Real-Time Pipelines (Hybrid)

ASX

Sydney

Hybrid

AUD 180,000 - 240,000

Full time

3 days ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Hybrid working options

Job summary

ASX is seeking a hands-on Data Engineer for the Derivatives Clearing Technology team within Markets Technology. You’ll ingest and curate core data assets, build source-aligned data products, and create consumable files, reports, dashboards and APIs.

You’ll drive standards, automation and robust pipelines in a critical market infrastructure environment. This hybrid role offers exposure to a diverse data landscape, involving AWS, Kafka, Airflow, and data visualization tools, with a focus on

Qualifications

Hands-on with AWS services for data ingestion, curation, storage and distribution.
Solid data modelling for data warehousing and governance.
Data product architecture with automation via DevSecOps.
Experience in real-time streaming using Kafka and AWS services.
Proficiency with Airflow, AWS Glue, Iceberg, Athena, Redshift and DataZone.
Data visualization tools including Tableau/Power BI/QuickSight.
Strong Python and Spark skills; Terraform/Terragrunt for infra-as-code.
Experience in a platform/product operating model with standardisation.
Knowledge of data mesh/data product concepts and federated ownership.
Background in Capital Markets and derivatives products.

Responsibilities

Embed within a data and reporting team to champion the central data platform.
Collaborate with domain data owners and engineers to deliver data products.
Ingest ASX core data assets and curate into source-aligned products, APIs, dashboards.
Contribute to a data engineering practice and drive standards and automation.
Ensure pipelines run reliably in a critical market infrastructure environment.