Senior Data Engineer — AWS, Glue & Airflow

M&T Resources; Sydney; On-site; AUD 150,000 - 210,000; Full time

Job summary

M&T Resources in Sydney seeks a Senior Data Engineer to join its Data & Integration Platform team. You will design and implement scalable data pipelines, partner with data owners and tech teams, and contribute to enterprise-scale data products.

The role focuses on AWS-based data technologies (Glue, Athena, Redshift) and streaming with Kafka, Spark, and Python to deliver analytics and APIs on complex platforms.

Qualifications

• 5–10 years’ Data Engineering experience.
• Strong Python and Spark skills.
• Knowledge of Kafka and real-time streaming.
• Strong stakeholder and communication skills.

Responsibilities

• Build and evolve enterprise data pipelines and products.
• Develop solutions across ingestion, curation, storage and distribution.
• Partner with data owners, SMEs and technology teams.
• Build real-time streaming solutions using Kafka and AWS.
• Develop reusable data frameworks and standards.

Skills

Data Engineering

Python

Spark

Kafka

Real-time streaming

Communication skills

Tools

AWS

Glue

Airflow

Iceberg

Athena

Redshift

DataZone

Job description

M&T Resources in Sydney seeks a Senior Data Engineer to join its Data & Integration Platform team. You will design and implement scalable data pipelines, partner with data owners and tech teams, and contribute to enterprise-scale data products.

The role focuses on AWS-based data technologies (Glue, Athena, Redshift) and streaming with Kafka, Spark, and Python to deliver analytics and APIs on complex platforms.