Senior Data Engineer / Consultant - Databricks

ICM Asia Pacific; New Zealand; Remote; NZD 140,000 - 210,000; Full time

Job summary

Adaptiv is a Kiwi data and cloud consultancy seeking Senior Data Engineers to deliver Databricks and Azure-based data solutions for diverse clients. You will design, build and optimise scalable data platforms, collaborating with clients, architects and delivery teams to ensure outcomes meet business needs.

As a senior contributor, you’ll shape solution design, mentor engineers, strengthen delivery standards and governance while engaging stakeholders for successful delivery across multiple NZ

Qualifications

• Significant commercial data engineering experience in enterprise environments.
• Hands-on Databricks and Azure data solutions experience.
• Strong Python, PySpark and SQL skills.
• Experience with Lakehouse architectures and cloud-native platforms.
• Experience with CI/CD, Git and DevOps practices.
• Excellent stakeholder communication and delivery planning.

Responsibilities

• Design, build and optimise production data pipelines across Lakehouse and data warehouse environments.
• Develop high-quality data transformations using Python, PySpark and SQL for analytics, reporting and AI/ML workloads.
• Deliver solutions using Azure Databricks, Delta Lake, notebooks, workflows and Medallion Architecture.
• Mentor junior engineers and contribute to engineering framework improvements.
• Collaborate with architects and delivery teams on solution design and estimation.
• Communicate delivery progress, risks and decisions clearly to clients and internal teams.

Skills

Databricks

Python

PySpark

SQL

Data modeling

CI/CD

Git

Stakeholder engagement

Education

Bachelor's degree in a related field

Tools

Azure Databricks

Delta Lake

Databricks Workflows

Unity Catalog

Job description

ABOUT ADAPTIV

Adaptiv is a Kiwi success story specialising in Integration, Data, AI and Cloud Consulting. We help organisations unlock greater value from their data through modern integration and analytics solutions built on technologies including Databricks, Microsoft Azure, Microsoft Fabric, MuleSoft, Boomi and Solace.

Based in our Grey Lynn/Ponsonby offices, we offer a collaborative, people-first culture where curiosity, initiative and continuous learning are valued. We combine strong technical capability with a practical, down-to-earth approach and are looking for people who share that mindset.

We are ideally seeking candidates based in Auckland. We will also consider people located in Christchurch, Wellington or elsewhere in New Zealand who are able to travel when required.

ABOUT THE ROLE

We are looking for experienced Senior Data Engineers / Consultants to join our growing Data Practice.

These are hands-on consulting roles focused on delivering modern Databricks and Azure-based data solutions across a variety of client environments. You will work closely with clients, architects and delivery teams to design, build, deploy and optimise scalable data platforms that deliver meaningful business outcomes.

Success in this role requires strong engineering capability together with the confidence to engage directly with stakeholders, understand business requirements and translate them into practical, supportable data solutions.

As a senior member of the team, you will also contribute to solution design, mentor other engineers and help strengthen the frameworks, standards and reusable delivery practices supporting Adaptiv’s continued growth.

WHAT YOU’LL BE DOING

• Design, build and optimise production data pipelines across Lakehouse and data warehouse environments.
• Develop high-quality data transformations using Python, PySpark and SQL for analytics, reporting and AI/ML workloads.
• Deliver solutions using Azure Databricks, Delta Lake, notebooks, workflows and Medallion Architecture.
• Work with Lakeflow Spark Declarative Pipelines, formerly Delta Live Tables, where appropriate.
• Implement governance and security practices using capabilities such as Unity Catalog.
• Build and maintain automated deployment processes using Git, Databricks Asset Bundles and CI/CD pipelines.
• Work with orchestration technologies such as Databricks Workflows, Azure Data Factory or Apache Airflow.
• Implement automated testing, monitoring, data-quality and operational-support practices.
• Lead technical discussions and translate business requirements into practical engineering outcomes.
• Collaborate with architects and delivery teams on solution design, estimation and delivery planning.
• Communicate delivery progress, risks and technical decisions clearly to clients and internal stakeholders.
• Mentor junior and intermediate engineers and support knowledge sharing across the Data Practice.
• Contribute to the continuous improvement of engineering frameworks, templates and delivery standards.

WHAT YOU’LL BRING

• Significant commercial Data Engineering experience, ideally gained across complex enterprise environments.
• Strong recent hands-on experience delivering production solutions using Databricks.
• Demonstrated capability across Python, PySpark and SQL.
• Experience building Lakehouse, data warehouse or cloud-native data platforms.
• Practical experience with Delta Lake, notebooks, workflows and Medallion Architecture.
• Experience with modern Databricks capabilities such as Lakeflow/Delta Live Tables, Unity Catalog or Databricks Asset Bundles.
• Strong understanding of data modelling, scalable pipeline design and engineering-performance optimisation.
• Experience using Git, CI/CD and DevOps practices to deploy data solutions across environments.
• Experience implementing testing, monitoring, reconciliation or automated data-quality frameworks.
• Strong stakeholder engagement and communication capability.
• Experience gathering requirements and translating them into technical designs and delivery plans.
• Experience mentoring engineers or providing technical leadership while remaining hands-on.
• Relevant Databricks certification or a demonstrated commitment to ongoing professional development.
• Experience with Microsoft Fabric and the wider Azure Data Platform would be advantageous but is not essential where strong Databricks engineering capability is demonstrated.

ABOUT YOU

• You are a strong communicator who enjoys working directly with clients and stakeholders.
• You are self-motivated, organised and focused on successful delivery.
• You are comfortable balancing multiple priorities and working through ambiguity.
• You are curious, adaptable and committed to continuous learning.
• You have a strong problem-solving mindset and take ownership of delivery outcomes.
• You are professional, collaborative and enjoy contributing to a high-performing team.

WHY JOIN ADAPTIV?

• Join a high-performing, collaborative and supportive team.
• Deliver solutions using modern technologies including Databricks, Azure and Microsoft Fabric.
• Work across varied client environments and meaningful data-transformation programmes.
• Access genuine opportunities for career growth and technical development.
• Contribute to the development of Adaptiv’s growing Data Practice.
• Work from modern offices across Auckland, Christchurch, Wellington, Melbourne and Brisbane.
• Make a visible impact across client projects and the wider business.

Applicants must already hold the appropriate right to work in New Zealand.

If you are looking to combine hands-on Databricks engineering with consulting, stakeholder engagement and technical leadership, we would love to hear from you.