Senior Data Engineer - AWS Data Platform & Real-Time Streaming

M&T Resources; Sydney; On-site; AUD 120,000 - 160,000; Full time

Job summary

M&T Resources is seeking a Senior Data Engineer to join a financial services data team, focusing on modern AWS data technologies and enterprise-scale data platforms. You will build scalable pipelines and data products from ingestion to analytics, reporting, and APIs, while collaborating with data owners and technology teams.

Required: 5–10 years in data engineering, strong Python and Spark, expertise in Kafka and real-time streaming, and excellent stakeholder communication.

Qualifications

• 5 to 10 years’ Data Engineering experience.
• Strong Python and Spark skills.
• Knowledge of Kafka and real-time streaming.
• Strong stakeholder and communication skills.

Responsibilities

• Build and evolve enterprise data pipelines and products.
• Develop solutions across ingestion, curation, storage and distribution.
• Partner with data owners, SMEs and technology teams.
• Build real-time streaming solutions using Kafka and AWS.
• Develop reusable data frameworks and standards.

Skills

Python

Spark

Data engineering

Real-time streaming

Stakeholder communication

Tools

AWS

Glue

Airflow

Apache Iceberg

Athena

Redshift

Kafka

Job description

M&T Resources is seeking a Senior Data Engineer to join a financial services data team, focusing on modern AWS data technologies and enterprise-scale data platforms. You will build scalable pipelines and data products from ingestion to analytics, reporting, and APIs, while collaborating with data owners and technology teams.

Required: 5–10 years in data engineering, strong Python and Spark, expertise in Kafka and real-time streaming, and excellent stakeholder communication.