AWS Data Engineer – Real-Time Pipelines (Hybrid)

ASX; Sydney; Hybrid; AUD 120,000 - 180,000; Full time

Benefits offered by this job

Flexible working

Hybrid working options

Job summary

ASX is seeking a hands-on Data Engineer to join the Derivatives Clearing Technology team within ASX Technology in Sydney. You will collaborate with stakeholders, ingest core data assets, and curate data into consumable products like files, reports, dashboards and APIs.

You will work in a domain-aligned data product team, leveraging AWS, Airflow and modern data tooling to drive automation, governance and performance in a critical market infrastructure environment.

Qualifications

• Hands-on engineer with AWS data services expertise.
• Knowledge of data modelling and data warehousing best practices.
• Strong data product architecture and DevSecOps with automation.
• Experience in real-time streaming with Kafka and AWS services.
• Experience with Airflow, AWS Glue, Iceberg, Athena, Redshift and DataZone.
• Experience in data visualization tools like Tableau/Power BI/QuickSight.
• Proficient in Python, Spark, and Terraform/Terragrunt.

Responsibilities

• Collaborate with stakeholders to understand data objectives and evolve central data platform.
• Work with domain-aligned data product team with owners and SMEs.
• Hands-on ingestion of core data assets and creation of consumable files, reports, dashboards and APIs.
• Contribute to data engineering practice and promote standards and best practices.
• Ensure pipelines and products run in a critical market infrastructure environment.

Skills

AWS data services

Data modelling

DevSecOps automation

Real-time streaming

Airflow

Tableau/Power BI/QuickSight

Python

Spark

Terraform/Terragrunt

Kafka

Tools

AWS Glue

Apache Iceberg

Athena

Redshift

DataZone

Confluent Kafka

Tableau

Power BI

QuickSight

Job description

ASX is seeking a hands-on Data Engineer to join the Derivatives Clearing Technology team within ASX Technology in Sydney. You will collaborate with stakeholders, ingest core data assets, and curate data into consumable products like files, reports, dashboards and APIs.

You will work in a domain-aligned data product team, leveraging AWS, Airflow and modern data tooling to drive automation, governance and performance in a critical market infrastructure environment.