Lead Data Consultant - Databricks
Theta (NZ)
Get more replies from employers
Send a job-specific resume in minutes.
Benefits offered by this job
Job summary
Theta NZ is seeking an experienced Lead Data Consultant to join the Data and Insights Practice in Auckland. The role focuses on end-to-end data solution delivery with Databricks, Azure, and Microsoft Fabric, delivering reliable data pipelines and scalable platforms.
You will lead data engineering efforts, mentor engineers, and collaborate with stakeholders to shape designs, estimates, and delivery plans, ensuring high-quality outcomes for enterprise clients.
Qualifications
- Eight or more years in data engineering for enterprise-scale platforms and EDWs.
- Three or more years hands-on Databricks experience.
- Strong Databricks Workspace, Unity Catalog and Compute design and management experience.
- Experience with Databricks notebooks, workflows, Delta Live Tables and Lakeflow.
- Advanced SQL capability.
- Experience delivering modern Lakehouse, Warehouse or cloud-native data platforms.
- Understanding Delta Lake, Medallion Architecture and scalable solution design.
- Data modeling experience for analytics workloads.
- Git, CI/CD, DevOps and DataOps experience.
- Stakeholder engagement and communication skills.
- Mentoring or technical leadership.
- Experience using AI coding assistants (GitHub Copilot or Claude).
- Exposure to Microsoft Fabric and Azure Data Platform.
Responsibilities
- Design, build, and optimise data pipelines across Lakehouse and warehouse patterns, with a focus on reliability and performance.
- Develop robust data transformations that enable reporting, analytics, and AI use cases.
- Deliver production grade solutions using Databricks notebooks, workflows, Delta Live Tables and Lakeflow.
- Produce clean, maintainable SQL/Python data solution that meets agreed engineering standards.
- Implement automated testing, monitoring, data validation, and performance tuning to support stable operations.
- Apply modern data modelling and Medallion Architecture principles to create scalable, well-structured data products.
- Lead technical discovery and solution walkthroughs, translating business requirements into clear engineering scope and deliverables.
- Partner with architects and delivery teams to shape solution design, estimates, sequencing, and delivery plans.
- Provide clear communication on progress, risks, dependencies, and technical blockers to client stakeholders and delivery leadership.
- Conduct peer reviews and promote consistent patterns across coding, documentation, and deployment practices.
- Mentor team members, supporting capability uplift and delivery confidence.
- Contribute to Theta delivery assets including templates, reusable components, documentation, and continuous improvement initiatives.
Skills
Tools
Job description
Theta is seeking an experiencedLead Data Consultantto join theData and Insights Practice, based in theAuckland office. This is a priority hire within a team that values delivery excellence and a sustainable pace of work.
The role has a strongdata engineering focus, with accountability for leading the end-to-end build of modern data solutions. Close collaboration with client stakeholders, solution architects, and delivery teams is central to the position, with delivery centred onDatabricks,Azure, andMicrosoft Fabric. The objective is consistent, reliable implementation that enables measurable business outcomes through high quality data pipelines, modelling, and platform delivery.
- Design, build, and optimise data pipelines across Lakehouse and warehouse patterns, with a focus on reliability and performance
- Develop robust data transformations that enable reporting, analytics, and AI use cases
- Deliver production grade solutions using Databricks notebooks, workflows, Delta Live Tables, and Lakeflow
- Produce clean, maintainable SQL/Python data solution that meets agreed engineering standards
- Implement automated testing, monitoring, data validation, and performance tuning to support stable operations
- Apply modern data modelling and Medallion Architecture principles to create scalable, well-structured data products
- Lead technical discovery and solution walkthroughs, translating business requirements into clear engineering scope and deliverables
- Partner with architects and delivery teams to shape solution design, estimates, sequencing, and delivery plans
- Provide clear communication on progress, risks, dependencies, and technical blockers to client stakeholders and delivery leadership
- Conduct peer reviews and promote consistent patterns across coding, documentation, and deployment practices
- Mentor team members, supporting capability uplift and delivery confidence
- Contribute to Theta delivery assets including templates, reusable components, documentation, and continuous improvement initiatives
- At least eight years of data engineering experience delivering enterprise scale data platforms and Enterprise Data Warehouses, including complex integration, modelling, and production support requirements
- Three or more years of hands-on Databricks experience
- Strong Databricks Workspace, Unity Catalog and Compute design and management experience
- Strong experience with Databricks notebooks, workflows, Delta Live Tables and Lakeflow
- Advanced SQL capability
- Strong experience delivering modern Lakehouse, Warehouse or cloud-native data platforms
- Strong understanding of Delta Lake, Medallion Architecture and scalable solution design
- Strong experience with data modelling for analytics workloads
- Strong Git, CI/CD, DevOps and DataOps experience
- Experience implementing regression testing and data-quality frameworks
- Strong stakeholder engagement and communication skills
- Experience mentoring team members or providing technical leadership
- Experience using AI coding assistants, including GitHub Copilot or Claude coding agent
- Relevant Databricks certifications or a demonstrated commitment to ongoing professional development
- Exposure to Microsoft Fabric and Azure Data Platform and other relevant technologies
A successful candidate will bring strong data engineering capability alongside a clear commitment to people and stakeholder engagement. The role requires confident communication across technical and non technical audiences, with an ability to build trust, clarify expectations, and translate business needs into practical engineering scope. High standards in delivery, maintainability, and reliability are essential, balanced with delivery timelines and commercial considerations. A collaborative working style is important, including constructive peer feedback, mentoring, and contribution to a supportive team environment.
Applications are welcomed from experienced Senior Data Engineers with strong Databricks delivery experience who are seeking a role with meaningful client interaction and genuine team leadership. Suitable applicants will be contacted to share further detail on the opportunity and to discuss role preferences, development priorities, and what a strong next step looks like.
We have 30 years of experience as a New Zealand-owned technology consultancy. We take pride in our multicultural and diverse team of circa 290 skilled professionals. Our offices are in Auckland, Tauranga, Wellington, and Christchurch.
Working with clients in both the public and private sectors, we strive to deliver innovative solutions and enable smarter outcomes. Our company attracts some of the brightest minds in the industry, as we foster a culture of excellence and continuous learning.
- Our people are our greatest asset
- We conduct business ethically
- Invention, imagination and creativity are the foundation for growth
- We work with positive energy, enjoyment, humour and work/life balance
- Excellence is our passion, and we deliver what we promise - or more!
- We strive to take a pragmatic approach to all our activities
- We value and appreciate our natural environment and seek to play our part to maintain it
Theta offers a family friendly work environment with flexible work hours where practical; especially relevant for caregivers. We embrace gender equality and are committed to providing a supportive,diverseand inclusive work environment.
Theta is committed to giving back to the community and are avid supporters of Cure Kids. We compete in various adventure races and do many other things to raise money for Cure Kids. And wemake timefor the fun things in life!
We currently provide the following benefits to ensure your professional development and personal wellbeing:
- Professional growth and learning opportunities
- A competitive salary (commensuratewith experience)
- Hybrid working model- from a minimum of 2 days in the office
- Fully subsidised medical insurance for employees
- Heavily discounted medical insurance for immediate family of employees
- Enhanced parental leave payment - salary top-ups plus return-to-work incentive
- Internal Referral Incentive
- Staff Assistance Programme
- Sick leave from your first day on board
- Remote working options where practical and mutually agreed
- Daily fresh fruit basket, coffee machine, wide selection of teas and biscuits inall ofour offices.
- We are also an accredited employer with INZ
Please note, all potential employees will be required to consent to a Ministry of Justice criminal record check.
We are only accepting applications from those alreadyresidingin NZ with the relevant visas.
Ready to take your career to the next level? We would love to hear from you!
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
