Senior Data Engineer — Azure Databricks, Data Lake & BI

Whānau Āwhina Plunket; Christchurch; On-site; NZD 120,000 - 180,000; Full time

Benefits offered by this job

Two Well health Days

EAP

access to Fitness Passport

Job summary

Whānau Āwhina Plunket is seeking an experienced Senior Data Engineer to lead the Data and Insights team's data pipelines, warehouses and BI artifacts in Azure Databricks and Azure Data Lake.

You will shape architecture, governance and reliable data products across the organisation, while mentoring teammates and driving scalable analytics solutions. This is a full-time permanent role with flexible hours across New Zealand.

Qualifications

• You will have 5+ years in data engineering, data warehousing or related senior roles.
• Relevant degree in CS, math, statistics or related field.
• Proven expertise with Azure Databricks, Delta Lake and ADLS Gen2.
• Strong SQL, PySpark and Spark SQL proficiency for BI and analytics.
• Experience with medallion architecture and dimensional modelling.
• Knowledge of data quality, governance, testing and lineage practices.

Responsibilities

• Build and maintain data pipelines across raw to semantic layers using Azure Databricks, Delta Lake and PySpark.
• Design medallion architectures and semantic datasets for BI reporting and AI use cases.
• Develop and improve ETL processes, tooling and code bases.
• Monitor pipelines, fix data issues and validate outputs against business rules.
• Implement data quality, lineage, testing and access control practices.
• Create reports and dashboards; automate repeatable data requests.
• Support CI/CD and infrastructure-as-code across Databricks and Azure.
• Provide technical guidance, coaching and QA across the team.

Skills

Azure Databricks

Delta Lake

PySpark

Spark SQL

Power BI Service

Azure Data Factory

CI/CD

Terraform

Databricks Workflows

Data Warehousing

Dimensional Modelling

SQL

Python

Education

Bachelor's degree in Computer Science/Math/Statistics

Tools

Azure DevOps

Databricks Asset Bundles

Job description

Whānau Āwhina Plunket is seeking an experienced Senior Data Engineer to lead the Data and Insights team's data pipelines, warehouses and BI artifacts in Azure Databricks and Azure Data Lake.

You will shape architecture, governance and reliable data products across the organisation, while mentoring teammates and driving scalable analytics solutions. This is a full-time permanent role with flexible hours across New Zealand.