Senior data Engineer

Plunket; New Zealand; Remoto; NZD 120.000 - 170.000; Tempo pieno

Vantaggi offerti da questo lavoro

Two Well health days

EAP

Fitness Passport

Descrizione del lavoro

Whānau Āwhina Plunket is seeking a Senior Data Engineer to own and extend our data warehouses, reporting artefacts and data products. You will work in Azure Databricks, Delta Lake and Power BI Service, ensuring data reliability, governance and trusted reporting.

This is a full-time permanent role, based in New Zealand, with flexibility for part-time hours and remote work within the country. You will lead data pipelines, BI datasets and collaborate across Data and Insights, Digital and ICT

Competenze

• Five+ years of experience in data engineering, data warehouse development or similar senior role.
• Strong knowledge of data warehousing concepts and Kimball/dimensional modeling is desirable.
• Excellent problem solving and collaboration skills.

Mansioni

• Own and improve data pipelines across raw to semantic layers using Azure Databricks, Delta Lake, PySpark and Spark SQL.
• Design medallion architecture patterns and semantic datasets for BI and AI use cases.
• Develop and maintain ETL processes, tools and code with a focus on quality and governance.
• Monitor pipelines, resolve data issues and ensure outputs meet business rules.
• Contribute to CI/CD and infrastructure-as-code across Databricks and Azure.
• Provide technical guidance, code reviews and QA across the team.

Formazione

Degree in computer science, mathematics, statistics or related discipline

Descrizione del lavoro

At Whānau Āwhina Plunket we are looking for an experienced Senior Data Engineer to join our Data and Insights team.

Te Whiwhinga mahi | The opportunity

In this senior technical role, you will take ownership of maintaining, improving and extending our data warehouses, reporting artefacts, dashboards and data products. Working within our Azure Databricks, Azure Data Lake Storage Gen2 and Power BI Service environment, you will help ensure our data is reliable, well governed and ready to support trusted reporting and decision-making across the organisation.

You will provide hands‑on engineering capability alongside technical leadership, setting strong standards for pipeline development, testing, documentation, deployment and operational support. You will also work closely with colleagues across Data and Insights, Digital, ICT Operations and the wider organisation to turn complex business and reporting needs into practical, sustainable data solutions.

This is a full‑time permanent position, however we are willing to consider part time hours. This role must be based in New Zealand but can be done from anywhere around the country.

Your work will include:

• Building and maintaining data pipelines across raw, structured, curated and semantic layers using Azure Databricks, Delta Lake, PySpark and Spark SQL
  
• Designing medallion architecture patterns, dimensional models and semantic datasets for AI use cases, analytics and Power BI reporting
  
• Developing, maintaining and improving ETL processes, tools and code
  
• Monitoring pipeline performance, resolving data issues and validating outputs against agreed business rules
  
• Implementing data quality, reconciliation, testing, lineage and access‑control practices
  
• Building reports and dashboards and automating repeatable data requests and processes
  
• Contributing to CI/CD and infrastructure‑as‑code practices across Databricks and Azure
  
• Providing technical guidance, coaching, peer review and quality assurance across the team

You are an experienced data engineering professional who can combine strong technical capability with sound judgement, curiosity and a collaborative approach.

You are comfortable taking ownership of complex data pipelines and working through legacy logic, reporting requirements and dataquality issues. You can explain technical concepts clearly, build trusted relationships with stakeholders and respectfully challenge thinking when needed to achieve the right outcome.

Ideally, you will bring:

• At least five years’ experience as a Data Engineer, Data Warehouse Developer, Database Developer or in a similar role, including experience at a senior or specialist level
  
• A relevant qualification in computer science, mathematics, statistics or another related discipline
  
• Strong practical experience with Azure Databricks, Delta Lake and Azure Data Lake Storage Gen2
  
• Advanced SQL skills and production experience using PySpark and Spark SQL
  
• Experience designing and building medallion architecture layers for business intelligence and analytics
  
• Strong knowledge of data warehousing and modelling approaches, including dimensional or Kimball modelling, star schemas and semantic-layer design
  
• Experience developing and supporting ETL processes, data warehouses, data products, reports and dashboards
  
• Experience with data‑quality testing, reconciliation, schema evolution, MERGE or upsert patterns, optimisation and partitioning
  
• An understanding of Power BI Service and how curated datasets and semantic models support downstream reporting
  
• Familiarity with Azure Data Factory, Databricks Workflows and Repos, Azure DevOps CI/CD, Databricks Asset Bundles and Terraform or similar technologies
  

Whānau Āwhina Plunket is the largest service in Aotearoa supporting the health and wellbeing of tamariki under five and their whānau. The data products you develop will support people across our organisation to better understand our services, organisational performance and the needs of the communities we serve.

You will join a collaborative Data and Insights team where you can influence technical direction, improve engineering practices and contribute to meaningful work with a genuine social impact.

We are committed to supporting your wellbeing and ongoing learning and development, we offer Two Well health Days to proactively look after your wellbeing along with EAP and access to Fitness Passport.