Data Engineer - AWS

Australian Securities Exchange; Sydney; Hybrid; AUD 140,000 - 180,000; Full time

Job summary

Australian Securities Exchange (ASX) in Sydney seeks an experienced data engineer to ingest core data assets, curate them into source-aligned data products, and build consumable products such as files, reports, dashboards and APIs. You will join a domain-aligned data product team and work alongside Tech resources to ensure robust data pipelines for market infrastructure.

The role requires hands-on expertise with AWS data services, real-time streaming (Confluent Kafka), and strong Python/Spark

Qualifications

• Hands-on engineer with AWS data services for ingestion, curation, storage, orchestration, data management and distribution.
• Strong data modelling skills and experience in data warehousing best practices.
• Solid data product architecture with DevSecOps automation.
• Experience in real-time streaming with Confluent Kafka and AWS services.
• Experience with Airflow, AWS Glue, Iceberg, Athena, Redshift and DataZone.
• Experience with Tableau/Power BI/QuickSight for data visualization.
• Proficiency in Python, Spark and Terraform/Terragrunt.

Responsibilities

• Collaborate with stakeholders to understand data objectives and evolve the central data platform.
• Work with a domain-aligned data product team and engineering resources.
• Hands-on ingestion of core data assets and creation of consumable products (files, reports, dashboards, APIs).
• Contribute to data engineering practice and standard adoption.
• Ensure pipelines and products run in a critical market infrastructure environment.

Skills

AWS data services

Data modelling

Data product architecture

DevSecOps

Python

Spark

Terraform/Terragrunt

Data visualization

Confluent Kafka

Tableau/Power BI/QuickSight

Airflow

AWS Glue

Apache Iceberg

Athena

Redshift

DataZone

Tools

Airflow

AWS Glue

Apache Iceberg

Athena

Redshift

Confluent Kafka

Tableau

Power BI

QuickSight

Terraform

Terragrunt

Job description

Australian Securities Exchange – Sydney NSW

ASX: Powering Australia's financial markets

Why join the ASX?

When you join ASX, you're joining a company with a strong purpose - to power a stronger economic future by enabling a fair and dynamic marketplace for all.

In your new role, you'll be part of a leading global securities exchange with a strong brand. We are known for being a trusted market operator and an exciting data hub.

We are more than a securities exchange!

The ASX team brings together talented people from a diverse range of disciplines.

We run critical market infrastructure, with 1 in 3 people employed within technology. Yet we have a unique complexity of roles across a range of disciplines such as operations, program delivery, financial products, investor engagement, risk and compliance.

We're proud to foster a workplace where diversity is celebrated and inclusion is part of our everyday culture. Our employee-led networks champion LGBTIQ+ inclusion, promote gender equality, accessibility and wellbeing, inspire giving and volunteering, and celebrate cultural and religious events, creating a sense of belonging for all. As an AWEI Bronze employer and member of the Champions of Change Coalition for gender equality, we're committed to a fair and inclusive workplace where everyone can thrive.

The AWS Data Engineering team is part of the Data Platforms division within ASX Technology. We are a trusted partner and platform operator, empowering our customers to safely access, understand and share data, and create sustainable solutions in an agile way.

Your responsibilities

• Embedded within one of our line-of-business data and reporting teams, you will collaborate with stakeholders to understand their data objectives and champion the use and evolution of the central data platform.
• You will work within a domain-aligned data product team consisting of line-of-business data owners and SMEs working alongside engineering resources provided by Technology.
• You will be hands-on in the ingestion of ASX's core data assets by the product teams, their curation into source-aligned data products and the creation of consumable products in the form of files, reports, dashboards and APIs.
• You will form part of a data engineering practice and community that will design and drive the adoption of standards, frameworks and best practices.
• You will ensure data pipelines and products are designed and built to be run within a critical market infrastructure environment by the persistent product teams who build them.

Your experience and qualifications

Must hav e

• A hands-on engineer with deep experience working with a variety of AWS services for ingestion, curation, storage, orchestration, data management, analytics and distribution.
• Good knowledge of data modelling and how to structure data within a data warehousing environment, while following best practice data management standards.
• Solid data product architecture and solution design experience with a good working knowledge of DevSecOps practices to achieve high levels of automation across complex data pipelines.
• Experience in real time streaming using Confluence Kafka and AWS services.
• Experience with Airflow, AWS Glue, Apache Iceberg, Athena, RedShift and DataZone.
• Experience in Data visualization tools such as Tableau/Power BI/QuickSight.
• Solid experience in Python, Spark and Terraform/Terragrunt.

We make hiring decisions based on your skills, capabilities and experience, and how you'll help us to live our values.

If you need any adjustments during the application or interview process to help you present your best self, please let us know at *******@asx.com.au.

At ASX Group, our diverse workforce is essential to build and maintain a fair and dynamic marketplace. We support flexible working and offer hybrid working options. Even if our roles are advertised as full-time, we encourage you to apply if you are interested in part-time or other flexible working arrangements.

We will arrange for successful candidates to have background checks, including reference and police checks, completed as part of the on-boarding process.

To be considered for this position, candidates must be legally authorised to work in Australia on a permanent basis without any restrictions.