Data Engineer — Real-Time Platform (Hybrid)

ASX Operations Pty Ltd; Sydney; Híbrido; AUD 150.000 - 190.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Hybrid working options

Flexible working arrangements

Descripción de la vacante

ASX, Australia's leading securities exchange, is seeking a data engineer to help ingest and curate core data assets and create consumable products such as files, reports, dashboards and APIs.

You will join the Data & Integration Platform within ASX Technology, collaborating with data owners and SMEs, while applying DevSecOps practices to automate complex pipelines and ensure reliable operations in a critical market infrastructure environment.

Formación

• Hands-on experience with AWS data ingestion, curation, storage and analytics.
• In-depth data modelling in data warehousing.
• Strong data product architecture with DevSecOps automation.
• Experience with real-time streaming using Confluent Kafka and AWS services.
• Familiarity with Airflow, AWS Glue, Iceberg, Athena, Redshift and DataZone.
• Experience with data visualization tools like Tableau/Power BI/QuickSight.
• Proficiency in Python, Spark and Terraform/Terragrunt.

Responsabilidades

• Collaborate with stakeholders to understand data objectives and evolve the central data platform.
• Work within a domain-aligned data product team with data owners and SMEs.
• Ingest core data assets and curate into source-aligned data products and deliverables (files, reports, dashboards, APIs).
• Contribute to a data engineering practice, driving standards, frameworks and best practices.
• Ensure data pipelines and products run in a critical market infrastructure environment.

Conocimientos

Data engineering

Data modelling

DevSecOps

Python

Spark

Terraform

Herramientas

Airflow

AWS Glue

Apache Iceberg

Athena

Redshift

DataZone

Tableau

Power BI

QuickSight

Terraform/Terragrunt

Confluent Kafka

Descripción del empleo

ASX, Australia's leading securities exchange, is seeking a data engineer to help ingest and curate core data assets and create consumable products such as files, reports, dashboards and APIs.

You will join the Data & Integration Platform within ASX Technology, collaborating with data owners and SMEs, while applying DevSecOps practices to automate complex pipelines and ensure reliable operations in a critical market infrastructure environment.