Senior Data Engineer: Real-Time Pipelines & Mentorship

Westpac New Zealand; Auckland; On-site; NZD 140,000 - 180,000; Full time

Benefits offered by this job

4 weeks holiday + 5 wellbeing days

Banking benefits & superannuation

Internal mobility & growth

Job summary

Westpac New Zealand is seeking a Senior Data Engineer to lead and mentor the squad in building and maintaining CDC pipelines across diverse data sources. You will ensure platform reliability, security and regulatory compliance while partnering with stakeholders to deliver high-quality data products.

The role requires strong Java and Python skills, deep experience with Kafka, Spark and HDFS, and familiarity with Airflow, Terraform and modern DevOps practices.

Qualifications

• Tertiary qualifications in Computer Science, Information Systems, Engineering or related discipline, with relevant technical certifications preferred.
• Strong programming skills in Java and Python, and deep experience with data engineering patterns.

Responsibilities

• Provide technical leadership within the squad, shaping engineering practices, solution design, and platform stability.
• Ensure CDC platforms, data products, and pipelines remain reliable, secure, compliant, and aligned with regulatory requirements.
• Drive resolution of complex production issues, including coordinating on‑call coverage and incident response.
• Translate business and architecture requirements into scalable designs, align with technology standards.
• Maintain and improve service operations with SLAs, monitoring, and health metrics.

Skills

Java

Python

Kafka

HDFS

Spark

Airflow

Terraform

CI/CD

Containerisation

SonarQube

Snyk

Education

Bachelor's degree in Computer Science/Information Systems/Engineering

Tools

Airflow

Kafka

HDFS

Spark

Terraform

CI/CD pipelines

SonarQube

Snyk

Job description

Westpac New Zealand is seeking a Senior Data Engineer to lead and mentor the squad in building and maintaining CDC pipelines across diverse data sources. You will ensure platform reliability, security and regulatory compliance while partnering with stakeholders to deliver high-quality data products.

The role requires strong Java and Python skills, deep experience with Kafka, Spark and HDFS, and familiarity with Airflow, Terraform and modern DevOps practices.