Senior Data Engineer: CDC & Streaming Pipeline Lead

Westpac New Zealand; Wellington; On-site; NZD 150,000 - 210,000; Full time

Benefits offered by this job

4 weeks annual holiday + wellbeing

Leave options up to 4 weeks per year

Banking benefits and superannuation

Job summary

Westpac New Zealand is seeking a Senior Data Engineer in Wellington to lead data pipelines that capture changes across multiple data stores and stream to Kafka and HDFS. You will mentor engineers and align with risk and compliance while delivering high‑quality data products.

You will work with Java and Python, Kafka, Hadoop, Spark, and Airflow to ensure scalable, secure data solutions for analytics and regulatory reporting across the bank.

Qualifications

• 5+ years in software development, data engineering, or related discipline.
• Experience with data pipelines and CDC patterns is preferred.
• Secure software development practices for handling sensitive data.

Responsibilities

• Provide technical leadership within the squad, shaping engineering practices and platform stability.
• Ensure CDC platforms and data pipelines are reliable, secure, and compliant.
• Drive production issue resolution and incident response.
• Translate business requirements into scalable designs aligned with standards.
• Maintain service operations with SLAs and monitoring.
• Mentor engineers and uplift technical capabilities across the squad.
• Support prioritisation and manage dependencies with Leads and Delivery.

Skills

Java

Python

Kafkastack

Hadoop

Spark

Airflow

Terraform

CI/CD

Containerisation

SonarQube

Snyk

Education

CS/IS/Engineering degree

Tools

Kafka

HDFS

Snyk

SonarQube

Job description

Westpac New Zealand is seeking a Senior Data Engineer in Wellington to lead data pipelines that capture changes across multiple data stores and stream to Kafka and HDFS. You will mentor engineers and align with risk and compliance while delivering high‑quality data products.

You will work with Java and Python, Kafka, Hadoop, Spark, and Airflow to ensure scalable, secure data solutions for analytics and regulatory reporting across the bank.