Senior Cloud Data Platform Lead (Azure Databricks)

Statistics New Zealand; Wellington; Hybrid; NZD 135,000 - 182,000; Full time

Benefits offered by this job

Sick leave

Employee Assistance Programme (EAP)

Vision and hearing health benefits

Corporate rates

Study assistance

Social club

Job summary

Statistics New Zealand invites applications for a Principal Cloud Data Engineer to lead design and delivery of modern, cloud-native data platforms across the IDI and related programmes. You will guide architecture, governance, and delivery, partnering with stakeholders to enable secure, scalable data for evidence-based decision making in Aotearoa.

You will champion automation, DevOps practices and resilient operations while mentoring engineers and delivering shared platform capabilities across

Qualifications

• 7+ years in engineering leadership or equivalent senior technical leadership role.
• Deep expertise in Azure Databricks, Python, Delta Lake, Apache Spark and Azure data services.
• Extensive experience designing, migrating and optimising enterprise-scale cloud data platforms.
• Strong knowledge of data governance, data modelling, data quality, metadata management, and data lineage.
• Expertise in modern DevOps and CI/CD practices using Azure DevOps, Terraform, Git and ARM/Bicep.
• Focus on automation, security, reliability, scalability and operational excellence.
• Experience delivering shared platform capabilities supporting multiple teams and programmes.
• Understanding cloud security, compliance, resilience, monitoring and operational support in regulated environments.
• Excellent communication and ability to influence, coach and guide engineers and stakeholders.

Responsibilities

• Provide technical leadership across platform architecture, cloud engineering, governance and delivery.
• Drive reusable solutions, modern engineering practices and continuous improvement.
• Lead complex initiatives spanning platform modernisation, large-scale data migration and automation.
• Collaborate with stakeholders across Stats NZ to deliver scalable, secure data capabilities.
• Ensure platform security, reliability and operational excellence and support for government data use.

Skills

Azure Databricks

Delta Lake

Apache Spark

Python

Cloud architecture

Tools

Azure DevOps

Terraform

Git

ARM/Bicep

Job description

Statistics New Zealand invites applications for a Principal Cloud Data Engineer to lead design and delivery of modern, cloud-native data platforms across the IDI and related programmes. You will guide architecture, governance, and delivery, partnering with stakeholders to enable secure, scalable data for evidence-based decision making in Aotearoa.

You will champion automation, DevOps practices and resilient operations while mentoring engineers and delivering shared platform capabilities across