Lead Data Platform Engineer — Azure Databricks Expert

Waikato; Hamilton; Remote; NZD 120,000 - 180,000; Full time

Job summary

The University of Waikato is building a new enterprise data platform using Databricks on Azure. As a Senior Data Engineer, you will design, build and operate production data pipelines that bring data from University systems into the platform, plus integrations back to source and consuming systems.

You will lead complex data ingestion, integration and legacy data warehouse migration, building secure, scalable solutions and applying modern data engineering practices.

Qualifications

• 5+ years’ data engineering experience building production cloud data pipelines.
• Strong SQL and Python skills, including incremental ingestion and change data capture.
• Experience with DataOps, including Git, CI/CD, automated testing and secure data solutions.
• Experience with modern cloud data platforms such as Databricks, Microsoft Fabric or Snowflake, data modelling and complex data integration or migration.
• Proven mentoring skills and openness to AI-assisted development tools.

Responsibilities

• Build and evolve our new enterprise data platform.
• Lead complex data integration and migration.
• Mentor others and shape modern data engineering

Skills

SQL

Python

DataOps

Git

CI/CD

Automated testing

Mentoring

AI-assisted tools

Education

Bachelor's degree in CS/IT/Engineering or related field

Tools

Databricks

Microsoft Fabric

Snowflake

Job description

The University of Waikato is building a new enterprise data platform using Databricks on Azure. As a Senior Data Engineer, you will design, build and operate production data pipelines that bring data from University systems into the platform, plus integrations back to source and consuming systems.

You will lead complex data ingestion, integration and legacy data warehouse migration, building secure, scalable solutions and applying modern data engineering practices.