Data Engineer - Real-Time Data Platform (Hybrid)

Australian Securities Exchange; Sydney; Híbrido; AUD 120.000 - 190.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Hybrid work model

Flexible working arrangements

Descripción de la vacante

Australian Securities Exchange (ASX) is seeking a Senior Data Platform Engineer in Sydney to drive ingestion, curation and delivery of core data assets. You will collaborate with data owners and SMEs within the Data & Integration Platform team to build central data products and APIs.

You will shape data pipelines, adopt standards, and implement automation across end-to-end processes in a hybrid, flexible environment. Strong SQL/Python and cloud-native skills are required.

Formación

• Hands-on engineer with AWS data ingestion, curation, storage, orchestration, data management, analytics and distribution.
• Knowledge of data modelling in data warehousing with best practice data management.
• Solid data product architecture and DevSecOps automation across data pipelines.
• Experience in real-time streaming using Kafka and AWS services.
• Experience with Airflow, AWS Glue, Apache Iceberg, Athena, Redshift and DataZone.
• Experience in data visualization tools such as Tableau/Power BI/QuickSight.
• Proficiency in Python, Spark and Terraform/Terragrunt.

Responsabilidades

• Collaborate with stakeholders to understand data objectives and champion central data platform usage and evolution.
• Work within a domain-aligned data product team with data owners and SMEs alongside Technology resources.
• Hands-on ingestion of core data assets, curate into source-aligned data products and create consumable files, reports, dashboards and APIs.
• Contribute to a data engineering practice and drive standards, frameworks and best practices.
• Ensure data pipelines and products are designed to run in a critical market infrastructure environment.

Conocimientos

AWS data services

Data modelling

DevSecOps automation

Real-time streaming

Kafka

Airflow

AWS Glue

Apache Iceberg

Athena

Redshift

Data visualization

Python

Spark

Terraform/Terragrunt

Herramientas

Airflow

AWS Glue

Apache Iceberg

Athena

Redshift

DataZone

Tableau

Power BI

QuickSight

Kafka

Confluent Kafka

Terraform/Terragrunt

Descripción del empleo

Australian Securities Exchange (ASX) is seeking a Senior Data Platform Engineer in Sydney to drive ingestion, curation and delivery of core data assets. You will collaborate with data owners and SMEs within the Data & Integration Platform team to build central data products and APIs.

You will shape data pipelines, adopt standards, and implement automation across end-to-end processes in a hybrid, flexible environment. Strong SQL/Python and cloud-native skills are required.