Lead Data Platform Engineer (Azure & Fabric)

UNSW College; Randwick City Council; On-site; AUD 180,000 - 240,000; Full time

Benefits offered by this job

Enhanced Parental leave

Access to Fitness Passport and UNSW FC

UNSW Training

Novated leasing

Christmas leave

Job summary

UNSW College is seeking a Lead Data Platform Engineer to join our IT team. You will lead the design, development and evolution of the enterprise data platform using Microsoft Fabric, Azure and Power BI, guiding architecture and delivery.

You will design Lakehouse and Data Warehouse solutions, orchestrate data pipelines, and implement DevOps practices within Fabric, enabling trusted analytics and impactful student outcomes across our campus and continuing education programs.

Qualifications

• Extensive experience in the design, development, and operation of modern cloud-based data platforms, pipelines and integrations using Microsoft Azure and Microsoft Fabric technologies.
• Deep expertise designing Lakehouses and Data Warehouses using the Medallion architecture; strong Delta Lake storage and DirectLake performance knowledge.
• Expertise in orchestrating complex data pipelines using Fabric Data Factory with PySpark/SQL notebooks for large-scale transformations.
• Proven experience implementing DevOps practices within Fabric, including Git integration and deployment pipelines.

Responsibilities

• Provide technical leadership and architectural guidance for the enterprise data platform roadmap and delivery.
• Design, build and optimise Microsoft Fabric data platform solutions (Lakehouse, Data Warehouse, Data Pipelines, Notebooks, Real-Time Analytics).
• Architect scalable data engineering solutions with modern ETL/ELT patterns, orchestration frameworks and integrations.
• Act as the technical authority for Azure and Microsoft data technologies (Fabric, Databricks, Purview, Power BI).
• Define and enforce data engineering standards, modelling and CI/CD practices; ensure security, documentation and release management.
• Collaborate with academic and professional teams to meet organisational objectives.

Skills

Azure

Microsoft Fabric

Power BI

Data Architecture

DevOps

PySpark

SQL

Data Warehouses

Lakehouse

ETL/ELT

Tools

Databricks

Microsoft Purview

Delta Lake

CI/CD

Git

Job description

UNSW College is seeking a Lead Data Platform Engineer to join our IT team. You will lead the design, development and evolution of the enterprise data platform using Microsoft Fabric, Azure and Power BI, guiding architecture and delivery.

You will design Lakehouse and Data Warehouse solutions, orchestrate data pipelines, and implement DevOps practices within Fabric, enabling trusted analytics and impactful student outcomes across our campus and continuing education programs.