Senior Data Engineer - Databricks / Azure

Younity; Auckland; On-site; NZD 120,000 - 180,000; Full time

Job summary

Jora New Zealand is seeking an experienced Senior Data Engineer to design, build and optimise a modern cloud-based data platform with a strong focus on Databricks, Azure and scalable data engineering. This hands-on senior role suits someone who enjoys solving complex data problems, building robust pipelines and working across both batch and real-time data environments.

The role involves designing scalable data pipelines, developing data workflows using Python, PySpark and SQL, and working with

Qualifications

• 5+ years' experience in Data Engineering.
• At least 2 years' strong hands-on Databricks experience.
• Strong Python, PySpark and SQL capability.
• Solid experience with Azure Data Factory.
• Strong understanding of Apache Spark and Delta Lake.
• Experience with Azure Data Lake and broader Azure data services.
• Experience building production-grade batch and/or streaming pipelines.
• Good understanding of data modelling, data warehousing and lakehouse concepts.
• Experience with Git, CI/CD and modern engineering practices.

Responsibilities

• Designing and building scalable data pipelines using Databricks and Azure Data Factory.
• Developing data workflows using Python, PySpark and SQL.
• Building and optimising ETL/ELT pipelines across cloud and on-premise data sources.
• Working with Delta Lake, CDC and lakehouse architecture.
• Developing batch and real-time data processing solutions.
• Working with Spark Structured Streaming, Event Hubs and Kafka.
• Optimising Spark workloads, Databricks jobs and data storage patterns.
• Designing data models for analytical and operational use cases.
• Improving data quality, monitoring, governance and reliability.
• Supporting CI/CD, code reviews and engineering best practices.
• Mentoring other engineers and contributing to technical standards.

Skills

Databricks

Azure Data Factory

Python

PySpark

SQL

Delta Lake

Spark

Event Hubs

Kafka

CI/CD

Git

Docker

Azure Data Lake

Lakehouse

MLOps

Data governance

Unity Catalog

IaC

Tools

Docker

Job description

Jora New Zealand will close on 9th September 2026. Thank you for being with us, we are cheering you on as you continue your career journey.

Join a well-known NZ organisation investing heavily in its digital and data capability. We’re looking for an experienced Senior Data Engineer to help design, build and optimise a modern cloud-based data platform, with a strong focus on Databricks, Azure and scalable data engineering.

This is a hands-on senior role suited to someone who enjoys solving complex data problems, building robust pipelines and working across both batch and real-time data environments.

What you'll be doing

• Designing and building scalable data pipelines using Databricks and Azure Data Factory
• Developing data workflows using Python, PySpark and SQL
• Building and optimising ETL/ELT pipelines across cloud and on-premise data sources
• Working with Delta Lake, CDC and lakehouse architecture
• Developing batch and real-time data processing solutions
• Working with technologies such as Spark Structured Streaming, Event Hubs and Kafka
• Optimising Spark workloads, Databricks jobs and data storage patterns
• Designing data models for analytical and operational use cases
• Improving data quality, monitoring, governance and reliability
• Supporting CI/CD, code reviews and engineering best practice
• Mentoring other engineers and contributing to technical standards

What we're looking for

• 5+ years' experience in Data Engineering
• At least 2 years' strong hands-on Databricks experience
• Strong Python, PySpark and SQL capability
• Solid experience with Azure Data Factory
• Strong understanding of Apache Spark and Delta Lake
• Experience working with Azure Data Lake and broader Azure data services
• Experience building production-grade batch and/or streaming pipelines
• Good understanding of data modelling, data warehousing and lakehouse concepts
• Experience with Git, CI/CD and modern engineering practices
• Strong troubleshooting, performance optimisation and problem-solving skills

Experience with Unity Catalog, Kafka/Event Hubs, Docker, Infrastructure as Code, MLOps or data governance would be advantageous.

This is a great opportunity for a senior engineer who wants to work on a modern data platform in a highly visible environment where data plays an important role in the organisation's digital strategy.

#SCR-kelly-cappel