Data Engineer — Real-Time Cloud Data Platform

Australian Securities Exchange

Sydney

Hybrid

AUD 140,000 - 180,000

Full time

5 days ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Australian Securities Exchange (ASX) in Sydney seeks an experienced data engineer to ingest core data assets, curate them into source-aligned data products, and build consumable products such as files, reports, dashboards and APIs. You will join a domain-aligned data product team and work alongside Tech resources to ensure robust data pipelines for market infrastructure.

The role requires hands-on expertise with AWS data services, real-time streaming (Confluent Kafka), and strong Python/Spark

Qualifications

Hands-on engineer with AWS data services for ingestion, curation, storage, orchestration, data management and distribution.
Strong data modelling skills and experience in data warehousing best practices.
Solid data product architecture with DevSecOps automation.
Experience in real-time streaming with Confluent Kafka and AWS services.
Experience with Airflow, AWS Glue, Iceberg, Athena, Redshift and DataZone.
Experience with Tableau/Power BI/QuickSight for data visualization.
Proficiency in Python, Spark and Terraform/Terragrunt.

Responsibilities

Collaborate with stakeholders to understand data objectives and evolve the central data platform.
Work with a domain-aligned data product team and engineering resources.
Hands-on ingestion of core data assets and creation of consumable products (files, reports, dashboards, APIs).
Contribute to data engineering practice and standard adoption.
Ensure pipelines and products run in a critical market infrastructure environment.