Lead Data Consultant - Databricks
Theta
A complete application in a minute — tailored resume and cover letter, ready to send.
Benefits offered by this job
Job summary
Theta is seeking an experienced Lead Data Consultant to join the Data and Insights Practice, based in the Auckland office. This role centers on end-to-end data solutions using Databricks, Azure and Microsoft Fabric, delivering reliable data pipelines and models.
You will collaborate with client stakeholders, solution architects, and delivery teams, mentoring juniors and contributing to reusable assets and templates to elevate delivery quality.
Qualifications
- Eight+ years delivering enterprise-scale data platforms and EDWs.
- Three+ years hands-on Databricks experience.
- Strong Databricks Workspace, Unity Catalog and Compute design.
- Experience with Databricks notebooks, workflows, Delta Live Tables and Lakeflow.
- Advanced SQL capability.
- Experience delivering modern Lakehouse/cloud data platforms.
- Knowledge of Delta Lake and Medallion Architecture.
- Git, CI/CD, DevOps and DataOps experience.
- Stakeholder engagement and communication skills.
- Mentoring and technical leadership experience.
- Experience using AI coding assistants (GitHub Copilot/Claude).
- Databricks certifications or ongoing development commitment.
- Exposure to Microsoft Fabric and Azure Data Platform.
Responsibilities
- Design, build, and optimise data pipelines with reliability and performance.
- Develop robust data transformations for reporting, analytics, and AI use cases.
- Deliver production-grade solutions using Databricks notebooks, workflows, Delta Live Tables and Lakeflow.
- Produce clean, maintainable SQL/Python data solutions meeting engineering standards.
- Implement automated testing, monitoring, data validation, and performance tuning.
- Apply Medallion Architecture for scalable data products.
- Lead technical discovery and translate business requirements into engineering scope.
- Partner with architects and delivery teams on design, estimates, sequencing, and delivery plans.
- Provide clear communication on progress, risks, and blockers to stakeholders.
- Mentor team members and contribute to reusable assets and templates.
Skills
Tools
Job description
Theta is seeking an experienced Lead Data Consultant to join the Data and Insights Practice, based in the Auckland office. This is a priority hire within a team that values delivery excellence and a sustainable pace of work.
The role has a strong data engineering focus, with accountability for leading the end-to-end build of modern data solutions. Close collaboration with client stakeholders, solution architects, and delivery teams is central to the position, with delivery centred on Databricks, Azure, and Microsoft Fabric. The objective is consistent, reliable implementation that enables measurable business outcomes through high quality data pipelines, modelling, and platform delivery.
- Design, build, and optimise data pipelines across Lakehouse and warehouse patterns, with a focus on reliability and performance
- Develop robust data transformations that enable reporting, analytics, and AI use cases
- Deliver production grade solutions using Databricks notebooks, workflows, Delta Live Tables, and Lakeflow
- Produce clean, maintainable SQL/Python data solution that meets agreed engineering standards
- Implement automated testing, monitoring, data validation, and performance tuning to support stable operations
- Apply modern data modelling and Medallion Architecture principles to create scalable, well-structured data products
- Lead technical discovery and solution walkthroughs, translating business requirements into clear engineering scope and deliverables
- Partner with architects and delivery teams to shape solution design, estimates, sequencing, and delivery plans
- Provide clear communication on progress, risks, dependencies, and technical blockers to client stakeholders and delivery leadership
- Conduct peer reviews and promote consistent patterns across coding, documentation, and deployment practices
- Mentor team members, supporting capability uplift and delivery confidence
- Contribute to Theta delivery assets including templates, reusable components, documentation, and continuous improvement initiatives
A cover letter accompanying your application is requested
- At least eight years of data engineering experience delivering enterprise scale data platforms and Enterprise Data Warehouses, including complex integration, modelling, and production support requirements
- Three or more years of hands‑on Databricks experience
- Strong Databricks Workspace, Unity Catalog and Compute design and management experience
- Strong experience with Databricks notebooks, workflows, Delta Live Tables and Lakeflow
- Advanced SQL capability
- Strong experience delivering modern Lakehouse, Warehouse or cloud‑native data platforms
- Strong understanding of Delta Lake, Medallion Architecture and scalable solution design
- Strong experience with data modelling for analytics workloads
- Strong Git, CI/CD, DevOps and DataOps experience
- Experience implementing regression testing and data‑quality frameworks
- Strong stakeholder engagement and communication skills
- Experience mentoring team members or providing technical leadership
- Experience using AI coding assistants, including GitHub Copilot or Claude coding agent
- Relevant Databricks certifications or a demonstrated commitment to ongoing professional development
- Exposure to Microsoft Fabric and Azure Data Platform and other relevant technologies
A successful candidate will bring strong data engineering capability alongside a clear commitment to people and stakeholder engagement. The role requires confident communication across technical and non technical audiences, with an ability to build trust, clarify expectations, and translate business needs into practical engineering scope. High standards in delivery, maintainability, and reliability are essential, balanced with delivery timelines and commercial considerations. A collaborative working style is important, including constructive peer feedback, mentoring, and contribution to a supportive team environment.
Applications are welcomed from experienced Senior Data Engineers with strong Databricks delivery experience who are seeking a role with meaningful client interaction and genuine team leadership. Suitable applicants will be contacted to share further detail on the opportunity and to discuss role preferences, development priorities, and what a strong next step looks like.
We have 30 years of experience as a New Zealand-owned technology consultancy. We take pride in our multicultural and diverse team of circa 290 skilled professionals. Our offices are in Auckland, Tauranga, Wellington, and Christchurch.
Working with clients in both the public and private sectors, we strive to deliver innovative solutions and enable smarter outcomes. Our company attracts some of the brightest minds in the industry, as we foster a culture of excellence and continuous learning.
- Our people are our greatest asset
- We conduct business ethically
- Invention, imagination and creativity are the foundation for growth
- We work with positive energy, enjoyment, humour and work/life balance
- Excellence is our passion, and we deliver what we promise - or more!
- We strive to take a pragmatic approach to all our activities
- We value and appreciate our natural environment and seek to play our part to maintain it
Theta offers a family friendly work environment with flexible work hours where practical; especially relevant for caregivers. We embrace gender equality and are committed to providing a supportive,diverseand inclusive work environment.
Theta is committed to giving back to the community and are avid supporters of Cure Kids. We compete in various adventure races and do many other things to raise money for Cure Kids. And wemake timefor the fun things in life!
We currently provide the following benefits to ensure your professional development and personal wellbeing:
- Professional growth and learning opportunities
- A competitive salary (commensuratewith experience)
- Hybrid working model– from a minimum of 2 days in the office
- Fully subsidised medical insurance for employees
- Heavily discounted medical insurance for immediate family of employees
- Enhanced parental leave payment – salary top-ups plus return-to-work incentive
- Volunteer days
- Internal Referral Incentive
- Staff Assistance Programme
- Annual Flu injections
- Sick leave from your first day on board
- Remote working options where practical and mutually agreed
- Daily fresh fruit basket, coffee machine, wide selection of teas and biscuits inallofour offices.
- We are also an accredited employer with INZ
Please note, all potential employees will be required to consent to a Ministry of Justice criminal record check.
We are only accepting applications from those already residing in NZ with the relevant visas.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
