Principal Cloud Data Engineer

Randstad; Wellington; On-site; NZD 120,000 - 180,000; Full time

Job summary

Randstad Wellington is seeking a Principal Cloud Data Engineer to lead strategy, design and execution of enterprise data platform services, focusing on cloud-native, secure, scalable solutions across platform and data product teams.

You will mentor engineers, drive governance and DevOps practices, and advise senior stakeholders on data strategy within a public sector context, including Unity Catalog, Delta Lake, and Azure Databricks.

Qualifications

• 5+ years senior-level experience in cloud data engineering, data architecture, or platform delivery.
• Hands-on expertise with Azure Databricks, Python, Delta Lake, Spark, and Azure Data Services.
• Strong experience designing cloud pipelines and implementing IaC/DevOps (Terraform, Bicep, Azure DevOps).
• Deep understanding of data modeling, metadata management, and governance tools like Unity Catalog.
• Proven dedication to public sector standards, strict data governance, and national security frameworks

Responsibilities

• Provide strategic and tactical technical leadership across enterprise data platform and product teams.
• Design, build, and optimise scalable, secure cloud-native data pipelines (batch and streaming).
• Lead the technical development of reusable, fit-for-purpose data products on Azure Databricks.
• Establish, document, and evolve engineering standards, data governance, and DevOps best practices.
• Provide expert architectural advice, risk assessments, and technical strategy to senior ICT leadership.
• Mentor, coach, and uplift the capabilities of engineers and analysts across squads.

Skills

Cloud data engineering

Data governance

Architectural leadership

Azure Databricks

Python

Delta Lake

Spark

Terraform

Bicep

Azure DevOps

Education

Bachelor Degree

Tools

Azure Databricks

Python

Delta Lake

Spark

Azure Data Services

Terraform

Bicep

Azure DevOps

Unity Catalog

Job description

• Principal/Enterprise Level focused on technical governance, platform strategy & technical advisory
• Azure Databricks, Python, Delta Lake, Spark, and Azure Data Services IaC/DevOps
• Wellington based, Fixed Term till June 2027 (potential extension/multi-year program)

ABOUT THE ROLE

Reporting to the Head of ICT Architecture, the Principal Cloud Data Engineer is a key technical leadership position responsible for guiding the strategy, design, and execution of enterprise data platform services. In this role, you will lead complex initiatives spanning platform and data product teams, driving the adoption of cloud-native architectures that are secure, scalable, and fit-for-purpose. You will serve as a trusted technical advisor to senior platform owners and principal architects, ensuring that data solutions align with overall business vision and long-term capability roadmaps.

KEY RESPONSIBILITIES

• Provide strategic and tactical technical leadership across enterprise data platform and product teams.
• Design, build, and optimise scalable, secure cloud-native data pipelines (batch and streaming).
• Lead the technical development of reusable, fit-for-purpose data products on Azure Databricks.
• Establish, document, and evolve engineering standards, data governance, and DevOps best practices.
• Provide expert architectural advice, risk assessments, and technical strategy to senior ICT leadership.
• Mentor, coach, and uplift the capabilities of engineers and analysts across squads.

SKILLS & EXPERIENCE

• 5+ years senior-level experience in cloud data engineering, data architecture, or platform delivery.
• Hands-on expertise with Azure Databricks, Python, Delta Lake, Spark, and Azure Data Services.
• Strong experience designing cloud pipelines and implementing IaC/DevOps (Terraform, Bicep, Azure DevOps).
• Deep understanding of data modeling, metadata management, and governance tools like Unity Catalog.
• Proven dedication to public sector standards, strict data governance, and national security frameworks

At Randstad, we are passionate about providing equal employment opportunities and embracing diversity to the benefit of all. We actively encourage applications from any background.

experience

5 years

skills

Experienced Data Platform Architect (Databricks)

qualifications

• Bachelor Degree

education

Bachelor Degree