Senior Data Platform Lead - Azure Databricks & Terraform

Randstad New Zealand; Wellington; On-site; NZD 150,000 - 210,000; Full time

Job summary

Randstad New Zealand seeks a Lead Data Engineer (Azure & Databricks) to shape the technical vision for a next-generation enterprise data platform in Wellington. You will guide design, delivery, and cloud-native best practices, mentoring an Agile team while partnering with architects and stakeholders to meet governance and analytics standards.

You will drive secure, cost-efficient cloud data services across Azure, Databricks, and containerised environments, ensuring scalable data sharing and

Qualifications

• Proven experience designing and delivering enterprise cloud data platforms at scale.
• Deep expertise in Azure Databricks, Apache Spark, Delta Lake, and Terraform (IaC).
• Strong knowledge of cloud-native architecture, containerization (AKS, Docker), and security integrations.
• Experience with modern data governance tools and compliance frameworks.
• Proven background mentoring engineers and leading technical delivery within Agile environments.
• Excellent communication skills to translate cloud data strategies to varied audiences.

Responsibilities

• Lead technical design and delivery of Azure data services, Databricks, and streaming solutions.
• Champion DevOps, IaC (Terraform, Azure DevOps), CI/CD pipelines, and proactive observability.
• Provide technical mentorship and hands-on guidance to uplift data engineering capability.
• Partner with architects and stakeholders to align platform features with organisational goals.
• Evolve platform architecture to support secure data sharing, analytics, and governance.
• Drive technical governance, platform standardisation, and cloud-first delivery practices.

Skills

Azure Databricks

Apache Spark

Delta Lake

Terraform

AKS

Docker

Cloud-native architecture

Agile mentoring

Data governance

Education

Bachelor Degree

ICT

Tools

Azure Databricks

Delta Lake

Terraform (IaC)

AKS

Docker

CI/CD

Azure DevOps

Job description

Randstad New Zealand seeks a Lead Data Engineer (Azure & Databricks) to shape the technical vision for a next-generation enterprise data platform in Wellington. You will guide design, delivery, and cloud-native best practices, mentoring an Agile team while partnering with architects and stakeholders to meet governance and analytics standards.

You will drive secure, cost-efficient cloud data services across Azure, Databricks, and containerised environments, ensuring scalable data sharing and