Senior Data Engineer — Azure Databricks Platform Lead

Skills Group; Auckland; Hybrid; NZD 150,000 - 190,000; Full time

Benefits offered by this job

Health insurance

Hybrid work

KiwiSaver contribution

Referral bonus

Learning & development

Job summary

Skills Group is seeking a Senior Data Engineer to lead the evolution of our Azure Databricks lakehouse, expanding Delta Lake and Unity Catalog capabilities. You’ll guide architecture, data governance, and product delivery, while mentoring a small team in a hybrid Auckland-based role.

You’ll own design decisions, partner with analytics and BI, and raise engineering standards across our data platform. Strong Azure and Python skills are essential for success.

Qualifications

• Bachelor's degree or equivalent industry experience.
• Proven production experience with Azure Databricks, Delta Lake and Unity Catalog.
• Strong SQL and Python, with data modelling and scalable pipelines.
• Experience with CI/CD and infrastructure-as-code.
• Leadership or mentoring experience in agile delivery.
• Excellent stakeholder management and communication.

Responsibilities

• Lead development and evolution of Azure Databricks lakehouse architecture.
• Design and build scalable ETL/ELT pipelines in SQL and Python.
• Mature CI/CD, infrastructure-as-code, DevOps, monitoring, and observability.

Skills

Azure Databricks

Delta Lake

Python

SQL

CI/CD

Mentoring

Education

Bachelor's degree or equivalent

Tools

Azure Data Factory

Azure Data Lake Storage Gen2

Azure Key Vault

Power BI

Job description

Skills Group is seeking a Senior Data Engineer to lead the evolution of our Azure Databricks lakehouse, expanding Delta Lake and Unity Catalog capabilities. You’ll guide architecture, data governance, and product delivery, while mentoring a small team in a hybrid Auckland-based role.

You’ll own design decisions, partner with analytics and BI, and raise engineering standards across our data platform. Strong Azure and Python skills are essential for success.