Lead Data Engineering - Databricks & Architecture

NHVR External Careers; City of Brisbane; Hybrid; AUD 155,000 - 170,000; Full time

Benefits offered by this job

Hybrid work up to 2 days from home

Wellbeing programs

Professional development support

Salary packaging options

Job summary

NHVR is seeking a Technical Lead, Data Engineering to guide a high‑performing team delivering smarter, more efficient regulatory outcomes. You will lead data architecture, lifecycle management, AI software development, information security, and agile delivery.

You will own the platform architecture, drive modernization with Databricks, and mentor engineers to strengthen governance and data quality across the NHVR Enterprise Data Platform.

Qualifications

• Master’s degree in information technology or computer science related or equivalent.
• Minimum 10 years’ experience with Databricks and Azure cloud platform.

Responsibilities

• Be accountable for data pipeline quality and data platform integrity.
• Evolve platform architecture and roadmap toward Lakehouse and Databricks capabilities.
• Design and improve metadata-driven ingestion and transformation framework.
• Define and enforce engineering standards, patterns, and CI/CD practices.
• Provide architecture guidance to senior stakeholders and manageability of data assets.
• Mentor Data Engineers and grow team capability in Databricks and modern engineering.
• Lead scrum planning, estimate technical effort, and assess risks.
• Act as escalation point for incidents and drive monitoring improvements.
• Represent changes at CAB and ensure release quality and security.
• Remain hands-on delivering complex pipeline components.

Skills

Databricks

Azure cloud

Python

PySpark

SQL

Delta Lake

Data governance

CI/CD

REST APIs

Scrum/Agile

Communication

Education

Master’s degree in IT/CS

Tools

Azure DevOps

Databricks

Job description

NHVR is seeking a Technical Lead, Data Engineering to guide a high‑performing team delivering smarter, more efficient regulatory outcomes. You will lead data architecture, lifecycle management, AI software development, information security, and agile delivery.

You will own the platform architecture, drive modernization with Databricks, and mentor engineers to strengthen governance and data quality across the NHVR Enterprise Data Platform.