Lead Data Engineer: Azure Databricks & Fabric (12m Contract)

The Network; Canberra; Hybrid; AUD 150,000 - 230,000; Full time

Job summary

The Network is seeking experienced Lead Data Engineers to deliver modern enterprise data platforms supporting analytics, reporting, AI and ML outcomes within a major Federal Government environment. This is a hands-on senior role with opportunities across Azure Databricks and Microsoft Fabric.

Location: ACT, NSW, VIC or QLD with Canberra based 3 days per week preferred. If you are an expert in Databricks, PySpark, Delta Lake or Microsoft Fabric, we’d like to hear from you.

Qualifications

• Hands-on senior role delivering enterprise data engineering solutions.
• Experience designing and delivering enterprise-scale data engineering projects.
• Ability to lead technical outcomes while remaining hands-on.

Responsibilities

• Design and deliver enterprise-scale data engineering solutions across analytics, AI and ML workloads.
• Lead technical outcomes and engage with stakeholders while contributing to engineering and development.
• Collaborate across Azure Databricks, Microsoft Fabric and related data platforms.

Skills

Azure Databricks

PySpark

Spark SQL

Python

SQL

Delta Lake

Lakehouse

Medallion architectures

Databricks Workflows

Unity Catalog

Azure Data Factory

ADLS Gen2

ETL/ELT pipelines

Data modelling

Data quality

Data lineage

Governance

Git

Azure DevOps

CI/CD

Automated testing

Analytics/AI/ML workloads

Technical leadership

Stakeholder engagement

Job description

The Network is seeking experienced Lead Data Engineers to deliver modern enterprise data platforms supporting analytics, reporting, AI and ML outcomes within a major Federal Government environment. This is a hands-on senior role with opportunities across Azure Databricks and Microsoft Fabric.

Location: ACT, NSW, VIC or QLD with Canberra based 3 days per week preferred. If you are an expert in Databricks, PySpark, Delta Lake or Microsoft Fabric, we’d like to hear from you.