Senior Data Engineer — Databricks & Azure Lead

ICM Asia Pacific; Auckland; On-site; NZD 120,000 - 180,000; Full time

Job summary

Adaptiv is a Kiwi success story specialising in Integration, Data, AI and Cloud Consulting. We are seeking experienced Senior Data Engineers/Consultants to join our growing Data Practice in Auckland, with travel to NP NZ as required.

You will design, build and optimise modern Databricks and Azure-based data solutions for diverse client environments, collaborating with clients, architects and delivery teams to translate business needs into scalable data platforms and tangible outcomes.

Qualifications

• Significant commercial Data Engineering experience in enterprise environments.
• Proficiency in Python, PySpark and SQL.
• Experience building Lakehouse, data warehouse or cloud-native platforms.
• Practical use of Delta Lake, notebooks, workflows and Medallion Architecture.
• Experience with Databricks capabilities such as Lakeflow/Delta Live Tables and Unity Catalog.

Responsibilities

• Design, build and optimise production data pipelines across Lakehouse and data warehouse environments.
• Develop data transformations using Python, PySpark and SQL for analytics, reporting and AI workloads.
• Deliver solutions using Azure Databricks, Delta Lake, notebooks, workflows and Medallion Architecture.
• Work with Lakeflow Spark Declarative Pipelines and orchestration tools.
• Implement governance and security practices with Unity Catalog.
• Build and maintain automated deployment processes with Git, Databricks Asset Bundles and CI/CD.
• Lead technical discussions and translate business requirements into engineering outcomes.
• Mentor junior engineers and contribute to reusable delivery practices.

Skills

Python

PySpark

SQL

Delta Lake

Databricks

Unity Catalog

Git

CI/CD

DevOps

Data testing & quality

Mentoring/leadership

Education

Databricks certification

Tools

Azure Databricks

Delta Live Tables

Unity Catalog

Git

Databricks Workflows

Job description

Adaptiv is a Kiwi success story specialising in Integration, Data, AI and Cloud Consulting. We are seeking experienced Senior Data Engineers/Consultants to join our growing Data Practice in Auckland, with travel to NP NZ as required.

You will design, build and optimise modern Databricks and Azure-based data solutions for diverse client environments, collaborating with clients, architects and delivery teams to translate business needs into scalable data platforms and tangible outcomes.