Data Engineer

M&T Resources; Sydney; On-site; AUD 110,000 - 150,000; Full time

Job summary

M&T Resources is seeking a Data Engineer to join a high-performing Data & Integration Platform team within a leading financial services organisation in Australia. This hands-on role focuses on modern, enterprise-scale data platforms, building scalable data products and pipelines across a complex tech environment.

You'll work with AWS technologies including Glue, Airflow, Iceberg, Athena, Redshift and DataZone to ingest, curate, store and distribute data, delivering analytics, reporting and APIs.

Qualifications

• Approximately 5 years of data engineering experience.
• Proficient in Python and Spark.
• Experience with Kafka and real-time streaming.
• Strong communication and stakeholder management skills.

Responsibilities

• Build and evolve enterprise data pipelines and products.
• Develop solutions across ingestion, curation, storage and distribution.
• Partner with data owners, SMEs and technology teams.
• Build real-time streaming solutions using Kafka and AWS.
• Develop reusable data frameworks and standards.

Skills

Data engineering

Python

Spark

Kafka

AWS

Airflow

Glue

Iceberg

Athena

Redshift

Communication

Stakeholder management

Tools

AWS

Airflow

Glue

Iceberg

Athena

Redshift

Job description

We're looking for a skilledData Engineer to join a high-performing Data & Integration Platform team within a leading financial services organisation.

This is a hands-on opportunity to work on modern, enterprise-scale data platforms, building scalable data products and pipelines across a complex technology environment.

You'll be working across AWS, Glue, Airflow, Apache Iceberg, Athena, Redshift and DataZone, building and evolving data products from ingestion through to analytics, reporting and APIs.

The Role:

• Build and evolve enterprise data pipelines and products.
• Develop solutions across ingestion, curation, storage and distribution.
• Partner with data owners, SMEs and technology teams.
• Build real-time streaming solutions using Kafka and AWS.
• Develop reusable data frameworks and standards.

• Build and evolve enterprise data pipelines and products.
• Develop solutions across ingestion, curation, storage and distribution.
• Partner with data owners, SMEs and technology teams.
• Build real-time streaming solutions using Kafka and AWS.
• Develop reusable data frameworks and standards.

What We’re Looking For:

• Around 5 years’ Data Engineering experience.
• Strong Python and Spark skills.
• Knowledge ofKafka and real-time streaming.
• Strong stakeholder and communication skills.

• Around 5 years’ Data Engineering experience.
• Strong AWS data platform experience.
• Hands-on Glue, Airflow, Iceberg, Athena, Redshift
• Strong Python and Spark skills.
• Knowledge ofKafka and real-time streaming.
• Strong stakeholder and communication skills.

If you're a data engineer looking to work with modern AWS data technologies on complex, high-impact data challenges, we'd love to hear from you.