Lead Data Consultant - Databricks

JobSpace; Wellington; Hybrid; NZD 120,000 - 180,000; Full time

Benefits offered by this job

Hybrid working model – 2 days in the:

Fully subsidised medical insurance

Remote working options where practical

Enhanced parental leave payment

Staff Assistance Programme

Sick leave from first day

INZ accredited employer

Job summary

Theta is seeking an experienced Lead Data Consultant to join the Data and Insights Practice in Auckland. The role focuses on end-to-end data platform delivery using Databricks, Azure, and Microsoft Fabric, with a strong data engineering emphasis and close collaboration with client stakeholders.

You will design and build scalable data pipelines, apply Medallion Architecture, mentor teammates, and contribute to reusable delivery assets while ensuring high quality and measurable business outcomes.

Qualifications

• Eight+ years of data engineering experience delivering enterprise scale data platforms.
• Three+ years of hands-on Databricks experience.
• Strong knowledge of Delta Lake, Medallion Architecture and scalable solution design.

Responsibilities

• Design, build, and optimise data pipelines across Lakehouse and warehouse patterns.
• Develop robust data transformations for reporting, analytics, and AI use cases.
• Deliver production-grade solutions using Databricks notebooks, workflows, Delta Live Tables and Lakeflow.
• Produce clean SQL/Python data solutions meeting engineering standards.
• Implement automated testing, monitoring, data validation and performance tuning.
• Apply modern data modelling and Medallion Architecture to create scalable data products.
• Lead technical discovery and solution walkthroughs translating business needs into engineering scope.
• Collaborate with architects and delivery teams on design, estimates, sequencing and plans.
• Provide clear progress updates on risks and blockers to stakeholders.
• Mentor team members and contribute to delivery assets and templates.

Skills

Data engineering

Stakeholder engagement

Azure

Databricks

Medallion Architecture

Python

SQL

Tools

Databricks

Azure

Microsoft Fabric

Git

CI/CD

DevOps

Lakehouse

Job description

Jora New Zealand will close on 9th September 2026. Thank you for being with us, we are cheering you on as you continue your career journey.

Theta is seeking an experienced Lead Data Consultant to join the Data and Insights Practice, based in the Auckland office. This is a priority hire within a team that values delivery excellence and a sustainable pace of work.

The role has a strong data engineering focus, with accountability for leading the end-to-end build of modern data solutions. Close collaboration with client stakeholders, solution architects, and delivery teams is central to the position, with delivery centred on Databricks, Azure, and Microsoft Fabric. The objective is consistent, reliable implementation that enables measurable business outcomes through high quality data pipelines, modelling, and platform delivery.

What the role delivers:

• Design, build, and optimise data pipelines across Lakehouse and warehouse patterns, with a focus on reliability and performance
• Develop robust data transformations that enable reporting, analytics, and AI use cases
• Deliver production grade solutions using Databricks notebooks, workflows, Delta Live Tables, and Lakeflow
• Produce clean, maintainable SQL/Python data solution that meets agreed engineering standards
• Implement automated testing, monitoring, data validation, and performance tuning to support stable operations
• Apply modern data modelling and Medallion Architecture principles to create scalable, well-structured data products
• Lead technical discovery and solution walkthroughs, translating business requirements into clear engineering scope and deliverables
• Partner with architects and delivery teams to shape solution design, estimates, sequencing, and delivery plans
• Provide clear communication on progress, risks, dependencies, and technical blockers to client stakeholders and delivery leadership
• Conduct peer reviews and promote consistent patterns across coding, documentation, and deployment practices
• Mentor team members, supporting capability uplift and delivery confidence
• Contribute to Theta delivery assets including templates, reusable components, documentation, and continuous improvement initiatives

Skills and experience:

• At least eight years of data engineering experience delivering enterprise scale data platforms and Enterprise Data Warehouses, including complex integration, modelling, and production support requirements
• Three or more years of hands-on Databricks experience
• Strong Databricks Workspace, Unity Catalog and Compute design and management experience
• Strong experience with Databricks notebooks, workflows, Delta Live Tables and Lakeflow
• Advanced SQL capability
• Strong experience delivering modern Lakehouse, Warehouse or cloud-native data platforms
• Strong understanding of Delta Lake, Medallion Architecture and scalable solution design
• Strong experience with data modelling for analytics workloads
• Strong Git, CI/CD, DevOps and DataOps experience
• Experience implementing regression testing and data-quality frameworks
• Strong stakeholder engagement and communication skills
• Experience mentoring team members or providing technical leadership
• Experience using AI coding assistants, including GitHub Copilot or Claude coding agent
• Relevant Databricks certifications or a demonstrated commitment to ongoing professional development
• Exposure to Microsoft Fabric and Azure Data Platform and other relevant technologies

About you:

A successful candidate will bring strong data engineering capability alongside a clear commitment to people and stakeholder engagement. The role requires confident communication across technical and non technical audiences, with an ability to build trust, clarify expectations, and translate business needs into practical engineering scope. High standards in delivery, maintainability, and reliability are essential, balanced with delivery timelines and commercial considerations. A collaborative working style is important, including constructive peer feedback, mentoring, and contribution to a supportive team environment.

About us:

We have 30 years of experience as a New Zealand-owned technology consultancy. We take pride in our multicultural and diverse team of circa 290 skilled professionals. Our offices are in Auckland, Tauranga, Wellington, and Christchurch.

Working with clients in both the public and private sectors, we strive to deliver innovative solutions and enable smarter outcomes. Our company attracts some of the brightest minds in the industry, as we foster a culture of excellence and continuous learning.

Theta values are at the heart of everything we do:

• Our people are our greatest asset
• We conduct business ethically
• Invention, imagination and creativity are the foundation for growth
• We work with positive energy, enjoyment, humour and work/life balance
• Excellence is our passion, and we deliver what we promise - or more!
• We strive to take a pragmatic approach to all our activities
• We value and appreciate our natural environment and seek to play our part to maintain it

Benefits of working at Theta:

Theta offers a family friendly work environment with flexible work hours where practical; especially relevant for caregivers. We embrace gender equality and are committed to providing a supportive, diverse and inclusive work environment.

Theta is committed to giving back to the community and are avid supporters of Cure Kids. We compete in various adventure races and do many other things to raise money for Cure Kids. And we make time for the fun things in life!

We currently provide the following benefits to ensure your professional development and personal wellbeing:

• Professional growth and learning opportunities
• A competitive salary (commensurate with experience)
• Hybrid working model – from a minimum of 2 days in the office
• Fully subsidised medical insurance for employees
• Heavily discounted medical insurance for immediate family of employees
• Enhanced parental leave payment – salary top-ups plus return-to-work incentive
• Internal Referral Incentive
• Staff Assistance Programme
• Sick leave from your first day on board
• Remote working options where practical and mutually agreed
• Daily fresh fruit basket, coffee machine, wide selection of teas and biscuits in all of our offices.
• We are also an accredited employer with INZ

Please note, all potential employees will be required to consent to a Ministry of Justice criminal record check. We are only accepting applications from those already residing in NZ with the relevant visas.