Lead Data Engineer: Enterprise Databricks Platform (Azure)

University of Waikato; Hamilton; On-site; NZD 110,000 - 170,000; Full time

Job summary

The University of Waikato is building a new enterprise data platform. You will design, build and operate production data pipelines using Databricks on Azure, bringing data from university systems into the platform and connecting data back to source applications.

As a senior data engineer, you will mentor engineers, shape data engineering standards, apply modern practices, and help grow AI-assisted development tools across the team, delivering secure and scalable data solutions for analytics and

Qualifications

• Bachelor's degree in computer science, information technology, engineering or a related field, or equivalent experience.
• 5+ years’ data engineering experience building production cloud data pipelines.
• Strong SQL and Python skills, including incremental ingestion and change data capture.
• Experience with DataOps, including Git, CI/CD, automated testing and secure data solutions.
• Experience with modern cloud data platforms such as Databricks, Microsoft Fabric or Snowflake, data modelling and complex data integration or migration.
• Proven mentoring skills and openness to AI-assisted development tools.

Responsibilities

• Build and operate production data pipelines that bring data from University systems into the new platform.
• Lead complex data integration and legacy data warehouse migration work.
• Mentor engineers and contribute to engineering standards and best practices.

Skills

5+ years data engineering

SQL

Python

DataOps

Databricks

Azure

data modelling

complex data integration

migration

mentoring

AI-assisted development tools

Education

Bachelor's degree

Tools

Databricks

Azure

Snowflake

Microsoft Fabric

Job description

The University of Waikato is building a new enterprise data platform. You will design, build and operate production data pipelines using Databricks on Azure, bringing data from university systems into the platform and connecting data back to source applications.

As a senior data engineer, you will mentor engineers, shape data engineering standards, apply modern practices, and help grow AI-assisted development tools across the team, delivering secure and scalable data solutions for analytics and