Senior Data Engineer AWS Real-Time Data Platforms - Hybrid

ASX Operations Pty Ltd; Sydney; Hybrid; AUD 140,000 - 190,000; Full time

Benefits offered by this job

Hybrid working options

Flexible working

Job summary

ASX Group seeks a data engineering professional to ingest and curate core data assets, building consumable files, dashboards and APIs within a central data platform. You will join the Derivatives Clearing Technology team under Markets Technology, collaborating with data owners and engineers to deliver reliable, standards-driven data products.

The role emphasizes real-time streaming, data modeling, DevSecOps automation and hands-on AWS services expertise, with a flexible hybrid working

Qualifications

• Hands-on engineer with extensive AWS data services experience.
• Strong data modeling within a data warehouse environment.
• Solid data product architecture with DevSecOps automation.
• Experience in real-time streaming with Confluent Kafka and AWS.
• Experience with Airflow, AWS Glue, Apache Iceberg, Athena, Redshift and DataZone.
• Experience in data visualization tools such as Tableau/Power BI/QuickSight.
• Proficiency in Python, Spark and Terraform/Terragrunt.

Responsibilities

• Collaborate with data stakeholders to define data objectives and evolve the central data platform.
• Work with a domain-aligned data product team and engineering resources.
• Ingest core data assets and curate them into source-aligned data products and consumables.
• Contribute to a data engineering practice, setting standards and best practices.
• Ensure pipelines run reliably in a critical market infrastructure environment.

Skills

AWS data ingestion

Data modelling

DevSecOps

Real-time streaming

Airflow

Python

Spark

Terraform

Terragrunt

Tableau/Power BI/QuickSight

Dataviz tools

Tools

Confluent Kafka

Airflow

Terraform

Terragrunt

Tableau

Power BI

QuickSight

AWS Glue

Athena

Redshift

Iceberg

Job description

ASX Group seeks a data engineering professional to ingest and curate core data assets, building consumable files, dashboards and APIs within a central data platform. You will join the Derivatives Clearing Technology team under Markets Technology, collaborating with data owners and engineers to deliver reliable, standards-driven data products.

The role emphasizes real-time streaming, data modeling, DevSecOps automation and hands-on AWS services expertise, with a flexible hybrid working