Senior Data Engineer - Regulatory Data Pipelines (PySpark)

Westpac New Zealand Limited; Auckland; Hybrid; NZD 120,000 - 180,000; Full time

Benefits offered by this job

Holiday allowance

Wellbeing leave

Purchased leave

Banking benefits

Insurance discounts

Superannuation

Growth opportunities

Internal mobility

Recognition

School holiday subsidy

Volunteer days

Job summary

Westpac New Zealand Limited is seeking a Data Engineer to design, build and maintain reliable data pipelines for FATCA, CRS and PTR regulatory reporting. You will ensure data is delivered on time, traceable and audit ready in a modern cloud data platform.

You will bring hands-on experience with Python, PySpark, Scala, SQL, and end-to-end ETL/ELT, plus AWS data services such as Glue, S3, RDS/Aurora and DataSync. Collaboration with DIP teams and CI/CD workflows is essential.

Qualifications

• Experience as Data Engineer on cloud-based data platforms.
• Proficient in Python and PySpark for data transformation and pipelines.
• Strong SQL skills for extraction, transformation and validation.
• Experience building end-to-end ETL/ELT pipelines in complex ecosystems.
• Knowledge of regulatory reporting data requirements.

Responsibilities

• Design, build, and maintain end-to-end data pipelines for FATCA, CRS and PTR.
• Ensure on-time, traceable, auditable data delivery across regulatory workloads.
• Collaborate with data teams and DIP for data ingestion and integration.
• Maintain CI/CD and deployment automation for pipelines.

Skills

Data Engineer

Python

PySpark

Scala

SQL

ETL/ELT pipelines

Regulatory reporting

Cloud data platforms

Batch processing

Orchestration

Tools

AWS Glue

Amazon S3

Amazon RDS/Aurora

AWS DataSync

DIP (Data Integration Platform)

CloudBees CI/CD

Job description

Westpac New Zealand Limited is seeking a Data Engineer to design, build and maintain reliable data pipelines for FATCA, CRS and PTR regulatory reporting. You will ensure data is delivered on time, traceable and audit ready in a modern cloud data platform.

You will bring hands-on experience with Python, PySpark, Scala, SQL, and end-to-end ETL/ELT, plus AWS data services such as Glue, S3, RDS/Aurora and DataSync. Collaboration with DIP teams and CI/CD workflows is essential.