Data Engineering Lead - Hybrid & Databricks

National Heavy Vehicle Regulator; City of Brisbane; Hybrid; AUD 150,000 - 183,000; Full time

Benefits offered by this job

Hybrid working environment

Competitive salary package

Superannuation

Wellbeing programs

Professional development

Job summary

National Heavy Vehicle Regulator (NHVR) seeks a strategic and hands-on Technical Lead, Data Engineering to guide a high-performing team in delivering smarter regulatory outcomes. You will own the data platform architecture, modernize pipelines with Databricks, and ensure data governance and security across the NHVR Enterprise Data Platform.

You will mentor engineers, drive the technical roadmap, and collaborate with senior stakeholders to uplift capabilities while delivering complex data

Qualifications

• Master’s degree in IT or computer science, or equivalent.
• Minimum 10 years’ experience with Databricks and Azure.
• Certifications in Databricks and/or Azure highly regarded.

Responsibilities

• Lead data engineering with Databricks and Azure cloud platform.
• Own platform architecture and technical roadmap.
• Mentor Data Engineers and lead agile Scrum teams.
• Ensure data quality, security, and governance across pipelines.

Skills

Python

PySpark

Databricks

Delta Lake

Unity Catalog

Data architecture

CI/CD

REST APIs

Scrum / Agile leadership

Azure

SQL

Education

Master’s degree in information technology or computer science

Equivalent experience

Tools

Azure cloud platform

Databricks notebooks & Jobs

Git-based workflows

Job description

National Heavy Vehicle Regulator (NHVR) seeks a strategic and hands-on Technical Lead, Data Engineering to guide a high-performing team in delivering smarter regulatory outcomes. You will own the data platform architecture, modernize pipelines with Databricks, and ensure data governance and security across the NHVR Enterprise Data Platform.

You will mentor engineers, drive the technical roadmap, and collaborate with senior stakeholders to uplift capabilities while delivering complex data