Senior Data Platform Engineer - AWS, PySpark, MLOps

Westpac Group; Sydney; On-site; AUD 180,000 - 280,000; Full time

Benefits offered by this job

Flexible work arrangements

Leave options: Culture, Lifestyle &amp

Wellbeing leave

Learning & development opportunities

Community volunteering

Job summary

Westpac Group is seeking an experienced data platform engineer in Sydney to design, build and operate cloud-native, event-driven data platforms and APIs. You will develop scalable data pipelines on AWS, ensure high-quality code and strong performance, and contribute to data governance in a regulated banking environment.

The role focuses on ML/AI data lifecycles, feature engineering, and reproducible MLOps pipelines, with collaboration across delivery, product, architecture, security, and

Qualifications

• Strong hands-on experience with PySpark and Java.
• Extensive experience on AWS, including AWS Glue and DynamoDB.
• Experience building event-driven architectures (Kafka) and RESTful APIs.
• Strong knowledge of data modelling, distributed data processing, and data quality.
• Experience supporting ML/AI data lifecycles, including feature engineering and RAG concepts.
• Solid understanding of CI/CD, DevOps practices, and SDLC principles.

Responsibilities

• Design, build, and support cloud-native, event-driven data platforms and APIs.
• Develop and operate scalable data pipelines and storage solutions on AWS.
• Build high-quality, secure, and maintainable code with strong performance and reliability.
• Optimise data pipelines, queries, and algorithms for scalability and cost efficiency.
• Produce and review technical designs, documentation, and operational runbooks.
• Engineer AI/ML-ready datasets with strong data quality, lineage, and governance.
• Enable MLOps practices such as reproducible pipelines, data versioning, and monitoring.
• Apply responsible AI, privacy, and data governance controls in regulated environments.
• Collaborate with delivery, product, architecture, security, and platform teams.
• Participate in code reviews, uplift engineering standards, and mentor others.
• Contribute to the strategic evolution of the data platform and engineering practices.

Skills

PySpark

Java

CI/CD

DevOps

SDLC

Data modelling

Data governance

Regulated environments

Communication

Team collaboration

Tools

AWS Glue

DynamoDB

Kafka

RESTful APIs

Job description

Westpac Group is seeking an experienced data platform engineer in Sydney to design, build and operate cloud-native, event-driven data platforms and APIs. You will develop scalable data pipelines on AWS, ensure high-quality code and strong performance, and contribute to data governance in a regulated banking environment.

The role focuses on ML/AI data lifecycles, feature engineering, and reproducible MLOps pipelines, with collaboration across delivery, product, architecture, security, and