Senior Data Engineer — Real-time Pipelines & Leadership

Westpac New Zealand Limited; Auckland; Hybrid; NZD 120,000 - 180,000; Full time

Benefits offered by this job

4 weeks standard holiday

Wellbeing leave

Banking benefits

Growth and development

Volunteer days

Job summary

Westpac New Zealand Limited is seeking a Senior Data Engineer to lead and mentor the squad while shaping data platforms and pipelines. You will ensure reliability, security, and regulatory alignment across CDC data flows from DB2, Oracle, and other sources to Kafka and HDFS.

You will apply your Java and Python expertise, leverage Kafka, Hadoop, Spark, and Airflow to deliver scalable data solutions in an Agile/DevOps environment and partner with stakeholders across the bank.

Qualifications

• 5+ years in software development or data engineering.
• Deep experience with CDC patterns and data streaming.
• Secure software development practices for handling sensitive data.
• Strong collaboration with stakeholders and teams.

Responsibilities

• Provide technical leadership and guidance within the squad.
• Design scalable data pipelines and maintain platform stability.
• Lead incident response and problem investigations.
• Mentor engineers and promote engineering excellence.

Skills

Java

Python

Kafka

Airflow

Hadoop

Spark

Terraform

CI/CD

Docker

SonarQube

Snyk

Agile

DevOps

Mentoring

Leadership

Education

Bachelors/Masters in Computer Science, Information Systems or Engineering

Tools

Kafka stack

HDFS

Spark

Docker

Terraform

Airflow

Snyk

SonarQube

Job description

Westpac New Zealand Limited is seeking a Senior Data Engineer to lead and mentor the squad while shaping data platforms and pipelines. You will ensure reliability, security, and regulatory alignment across CDC data flows from DB2, Oracle, and other sources to Kafka and HDFS.

You will apply your Java and Python expertise, leverage Kafka, Hadoop, Spark, and Airflow to deliver scalable data solutions in an Agile/DevOps environment and partner with stakeholders across the bank.