Senior Data Engineer

Whānau Āwhina Plunket; Tauranga; On-site; NZD 120,000 - 180,000; Full time

Benefits offered by this job

Two Well health Days

Employee Assistance Program (EAP)

Fitness Passport access

Job summary

Whānau Āwhina Plunket is seeking a Senior Data Engineer to own and evolve data warehouses, dashboards and data products. In our Azure Databricks, Delta Lake and Power BI environment, you will lead data engineering efforts and set standards for pipelines, testing and deployment.

You will provide hands-on delivery alongside technical leadership, collaborate across teams, and help turn complex business needs into practical data solutions that empower trusted reporting and decision-making.

Qualifications

• At least five years in data engineering, data warehousing or related senior roles.
• Strong grounding in data modelling, staging layers and BI readiness.
• Proven ability to design and implement reliable data pipelines.

Responsibilities

• Build and maintain data pipelines across raw, structured, curated and semantic layers using Azure Databricks, Delta Lake, PySpark and Spark SQL
• Design medallion architecture patterns and semantic datasets for BI reporting and AI use cases
• Develop, maintain and improve ETL processes, tools and code
• Monitor pipeline performance, resolve data issues and validate outputs against business rules
• Implement data quality, reconciliation, testing, lineage and access-control practices
• Build reports and dashboards and automate repeatable data requests and processes
• Contribute to CI/CD and infrastructure-as-code across Databricks and Azure
• Provide technical guidance, coaching and QA across the team

Skills

Azure Databricks

Delta Lake

Azure Data Lake Storage Gen2

PySpark

Spark SQL

Power BI Service

SQL

CI/CD

Terraform

Python

Data Warehousing

Data Governance

Team leadership

Education

Relevant qualification in computer science, mathematics, statistics or related discipline

Tools

Azure Databricks

Delta Lake

Azure Data Lake Storage Gen2

Power BI Service

Azure DevOps

Terraform

Databricks Workflows

Job description

At Whānau Āwhina Plunket we are looking for an experienced Senior Data Engineer to join our Data and Insights team.

Te Whiwhinga mahi | The opportunity

In this senior technical role, you will take ownership of maintaining, improving and extending our data warehouses, reporting artefacts, dashboards and data products. Working within our Azure Databricks, Azure Data Lake Storage Gen2 and Power BI Service environment, you will help ensure our data is reliable, well governed and ready to support trusted reporting and decision-making across the organisation.

You will provide hands‑on engineering capability alongside technical leadership, setting strong standards for pipeline development, testing, documentation, deployment and operational support. You will also work closely with colleagues across Data and Insights, Digital, ICT Operations and the wider organisation to turn complex business and reporting needs into practical, sustainable data solutions.

This is a full-time permanent position, however we are willing to consider part time hours. This role can be based anywhere in the country.

Your Work Will Include

• Building and maintaining data pipelines across raw, structured, curated and semantic layers using Azure Databricks, Delta Lake, PySpark and Spark SQL
• Designing medallion architecture patterns, dimensional models and semantic datasets for AI use cases, analytics and Power BI reporting
• Developing, maintaining and improving ETL processes, tools and code
• Monitoring pipeline performance, resolving data issues and validating outputs against agreed business rules
• Implementing data quality, reconciliation, testing, lineage and access‑control practices
• Building reports and dashboards and automating repeatable data requests and processes
• Contributing to CI/CD and infrastructure‑as‑code practices across Databricks and Azure
• Providing technical guidance, coaching, peer review and quality assurance across the team

He kōrero mōu | About you

You are an experienced data engineering professional who can combine strong technical capability with sound judgement, curiosity and a collaborative approach.

You are comfortable taking ownership of complex data pipelines and working through legacy logic, reporting requirements and dataquality issues. You can explain technical concepts clearly, build trusted relationships with stakeholders and respectfully challenge thinking when needed to achieve the right outcome.

Ideally, You Will Bring

• At least five years’ experience as a Data Engineer, Data Warehouse Developer, Database Developer or in a similar role, including experience at a senior or specialist level
• A relevant qualification in computer science, mathematics, statistics or another related discipline
• Strong practical experience with Azure Databricks, Delta Lake and Azure Data Lake Storage Gen2
• Advanced SQL skills and production experience using PySpark and Spark SQL
• Experience designing and building medallion architecture layers for business intelligence and analytics
• Strong knowledge of data warehousing and modelling approaches, including dimensional or Kimball modelling, star schemas and semantic layer design
• Experience developing and supporting ETL processes, data warehouses, data products, reports and dashboards
• Experience with data quality testing, reconciliation, schema evolution, MERGE or upsert patterns, optimisation and partitioning
• An understanding of Power BI Service and how curated datasets and semantic models support downstream reporting
• Familiarity with Azure Data Factory, Databricks Workflows and Repos, Azure DevOps CI/CD, Databricks Asset Bundles and Terraform or similar technologies

Experience working with health, social‑care or client information would be an advantage, as would proficiency in Python, R, JavaScript or Bash.

Ngā hua mahi o Te Whānau Āwhina | What we offer

Whānau Āwhina Plunket is the largest service in Aotearoa supporting the health and wellbeing of tamariki under five and their whānau. The data products you develop will support people across our organisation to better understand our services, organisational performance and the needs of the communities we serve.

You will join a collaborative Data and Insights team where you can influence technical direction, improve engineering practices and contribute to meaningful work with a genuine social impact.

We are committed to supporting your wellbeing and ongoing learning and development, we offer Two Well health Days to proactively look after your wellbeing along with EAP and access to Fitness Passport.