AWS Data Engineer - Real-Time Data Platform (Hybrid)

ASX Limited; Sydney; Hybrid; AUD 120,000 - 170,000; Full time

Benefits offered by this job

Hybrid work options

Job summary

ASX Limited is seeking a Data Engineer focused on AWS Data Services in Sydney, on-site. You will ingest core data assets, curate domain-aligned data products, and deliver consumable outputs like files, reports, dashboards and APIs.

You will contribute to data standards and build automated pipelines in a market-critical environment. Candidate should have strong experience with Python, Spark, Kafka, Airflow, Glue, Iceberg, Athena, RedShift and DataZone, plus data visualization tools such as

Qualifications

• Hands-on engineer with AWS data ingestion, curation, storage and distribution.
• Strong data modelling and warehouse design knowledge.
• Experience building data products and APIs for consumption.
• Proven DevSecOps practices to automate complex pipelines.
• Knowledge of real-time streaming with Kafka and AWS services.
• Experience with Airflow, Glue, Iceberg, Athena, RedShift and DataZone.
• Data visualization tools such as Tableau, Power BI, QuickSight.
• Programming in Python and Spark; Terraform/Terragrunt familiarity.

Responsibilities

• Ingest core ASX data assets and curate them into source-aligned products.
• Collaborate with data owners and SMEs within a domain-aligned data product team.
• Create consumable outputs: files, reports, dashboards and APIs.
• Contribute to a data engineering practice, defining standards and frameworks.
• Ensure pipelines run within a critical market infrastructure environment with governance.

Skills

AWS data services

Data modelling

Data pipelines

Python

Spark

DevSecOps

Kafka streaming

Airflow

Tableau

Power BI

QuickSight

Terraform/Terragrunt

Tools

Airflow

AWS Glue

Apache Iceberg

Athena

RedShift

DataZone

Tableau

Power BI

QuickSight

Terraform/Terragrunt

Job description

ASX Limited is seeking a Data Engineer focused on AWS Data Services in Sydney, on-site. You will ingest core data assets, curate domain-aligned data products, and deliver consumable outputs like files, reports, dashboards and APIs.

You will contribute to data standards and build automated pipelines in a market-critical environment. Candidate should have strong experience with Python, Spark, Kafka, Airflow, Glue, Iceberg, Athena, RedShift and DataZone, plus data visualization tools such as