Senior data Engineer

Plunket; Auckland; Remote; NZD 120,000 - 180,000; Full time

Benefits offered by this job

Two health days

Employee assistance program (EAP)

Fitness Passport access

Job summary

Whānau Āwhina Plunket is seeking an experienced Senior Data Engineer to join our Data and Insights team. In this role you will own and improve our data warehouses, reporting artefacts, dashboards and data products within our Azure Databricks, Delta Lake and Power BI environment.

You will lead by example, focus on building reliable data pipelines, enforcing data governance, and partnering with stakeholders across the organisation to deliver practical, scalable analytics solutions that support

Qualifications

• Five+ years as a Data Engineer or similar senior/lead role.
• Experience with data warehouses, pipelines and BI reporting.
• Strong understanding of governance, quality and security in data environments.

Responsibilities

• Own and extend data warehouses, ETL pipelines and data products.
• Build scalable, well-governed data pipelines and dashboards.
• Provide technical leadership and code quality guidance.
• Collaborate with Data and Insights, Digital and ICT operations teams.

Skills

SQL

PySpark

Spark SQL

Data modeling

ETL design

CI/CD

Stakeholder engagement

Leadership

Education

Computer science or related field

Mathematics or statistics background

Tools

Azure Databricks

Delta Lake

Azure Data Lake Storage Gen2

Power BI

Job description

At Whānau Āwhina Plunket we are looking for an experienced Senior Data Engineer to join our Data and Insights team.

Te Whiwhinga mahi | The opportunity

In this senior technical role, you will take ownership of maintaining, improving and extending our data warehouses, reporting artefacts, dashboards and data products. Working within our Azure Databricks, Azure Data Lake Storage Gen2 and Power BI Service environment, you will help ensure our data is reliable, well governed and ready to support trusted reporting and decision-making across the organisation.

You will provide hands‑on engineering capability alongside technical leadership, setting strong standards for pipeline development, testing, documentation, deployment and operational support. You will also work closely with colleagues across Data and Insights, Digital, ICT Operations and the wider organisation to turn complex business and reporting needs into practical, sustainable data solutions.

This is a full‑time permanent position, however we are willing to consider part time hours. This role must be based in New Zealand but can be done from anywhere around the country.

Your work will include:

• Building and maintaining data pipelines across raw, structured, curated and semantic layers using Azure Databricks, Delta Lake, PySpark and Spark SQL
  
• Designing medallion architecture patterns, dimensional models and semantic datasets for AI use cases, analytics and Power BI reporting
  
• Developing, maintaining and improving ETL processes, tools and code
  
• Monitoring pipeline performance, resolving data issues and validating outputs against agreed business rules
  
• Implementing data quality, reconciliation, testing, lineage and access‑control practices
  
• Building reports and dashboards and automating repeatable data requests and processes
  
• Contributing to CI/CD and infrastructure‑as‑code practices across Databricks and Azure
  
• Providing technical guidance, coaching, peer review and quality assurance across the team

You are an experienced data engineering professional who can combine strong technical capability with sound judgement, curiosity and a collaborative approach.

You are comfortable taking ownership of complex data pipelines and working through legacy logic, reporting requirements and dataquality issues. You can explain technical concepts clearly, build trusted relationships with stakeholders and respectfully challenge thinking when needed to achieve the right outcome.

Ideally, you will bring:

• At least five years’ experience as a Data Engineer, Data Warehouse Developer, Database Developer or in a similar role, including experience at a senior or specialist level
  
• A relevant qualification in computer science, mathematics, statistics or another related discipline
  
• Strong practical experience with Azure Databricks, Delta Lake and Azure Data Lake Storage Gen2
  
• Advanced SQL skills and production experience using PySpark and Spark SQL
  
• Experience designing and building medallion architecture layers for business intelligence and analytics
  
• Strong knowledge of data warehousing and modelling approaches, including dimensional or Kimball modelling, star schemas and semantic-layer design
  
• Experience developing and supporting ETL processes, data warehouses, data products, reports and dashboards
  
• Experience with data‑quality testing, reconciliation, schema evolution, MERGE or upsert patterns, optimisation and partitioning
  
• An understanding of Power BI Service and how curated datasets and semantic models support downstream reporting
  
• Familiarity with Azure Data Factory, Databricks Workflows and Repos, Azure DevOps CI/CD, Databricks Asset Bundles and Terraform or similar technologies
  

Whānau Āwhina Plunket is the largest service in Aotearoa supporting the health and wellbeing of tamariki under five and their whānau. The data products you develop will support people across our organisation to better understand our services, organisational performance and the needs of the communities we serve.

You will join a collaborative Data and Insights team where you can influence technical direction, improve engineering practices and contribute to meaningful work with a genuine social impact.

We are committed to supporting your wellbeing and ongoing learning and development, we offer Two Well health Days to proactively look after your wellbeing along with EAP and access to Fitness Passport.