Lead Data Platform Engineer

UNSW College; Randwick City Council; On-site; AUD 180,000 - 240,000; Full time

Benefits offered by this job

Enhanced Parental leave

Access to Fitness Passport and UNSW FC

UNSW Training

Novated leasing

Christmas leave

Job summary

UNSW College is seeking a Lead Data Platform Engineer to join our IT team. You will lead the design, development and evolution of the enterprise data platform using Microsoft Fabric, Azure and Power BI, guiding architecture and delivery.

You will design Lakehouse and Data Warehouse solutions, orchestrate data pipelines, and implement DevOps practices within Fabric, enabling trusted analytics and impactful student outcomes across our campus and continuing education programs.

Qualifications

• Extensive experience in the design, development, and operation of modern cloud-based data platforms, pipelines and integrations using Microsoft Azure and Microsoft Fabric technologies.
• Deep expertise designing Lakehouses and Data Warehouses using the Medallion architecture; strong Delta Lake storage and DirectLake performance knowledge.
• Expertise in orchestrating complex data pipelines using Fabric Data Factory with PySpark/SQL notebooks for large-scale transformations.
• Proven experience implementing DevOps practices within Fabric, including Git integration and deployment pipelines.

Responsibilities

• Provide technical leadership and architectural guidance for the enterprise data platform roadmap and delivery.
• Design, build and optimise Microsoft Fabric data platform solutions (Lakehouse, Data Warehouse, Data Pipelines, Notebooks, Real-Time Analytics).
• Architect scalable data engineering solutions with modern ETL/ELT patterns, orchestration frameworks and integrations.
• Act as the technical authority for Azure and Microsoft data technologies (Fabric, Databricks, Purview, Power BI).
• Define and enforce data engineering standards, modelling and CI/CD practices; ensure security, documentation and release management.
• Collaborate with academic and professional teams to meet organisational objectives.

Skills

Azure

Microsoft Fabric

Power BI

Data Architecture

DevOps

PySpark

SQL

Data Warehouses

Lakehouse

ETL/ELT

Tools

Databricks

Microsoft Purview

Delta Lake

CI/CD

Git

Job description

UNSW College is a leading provider of university pathway programs and career-focused qualifications, equipping students from around the world with the knowledge, skills and confidence to thrive at university and in an evolving world of work. We are committed to delivering high-quality education, fostering an inclusive learning environment, and supporting students throughout their academic journey.

About the Role

We are seeking a motivated and enthusiastic Lead Data Platform Engineer to join our IT team. This role offers the opportunity to take a leading technical role in the design, development and evolution of our enterprise data platform, working across Microsoft Fabric, Azure, Power BI, Microsoft Purview and modern data engineering technologies.

Your day to day will consist of:

• Provide technical leadership and architectural guidance for the roadmap, design, development, and delivery of the enterprise data platform, aligning Microsoft Fabric, Power BI, Microsoft Purview, and modern data engineering capabilities with the organisation's Data & AI strategy and enterprise objectives.
• Design, build and optimise Microsoft Fabric data platform solutions, including Lakehouse, Data Warehouse, Data Pipelines, Notebooks, Real-Time Analytics, and semantic models to enable trusted enterprise analytics and business insights.
• Architect and develop scalable data engineering solutions using modern ETL/ELT patterns, orchestration frameworks, and integration technologies to ingest, transform, curate, and distribute data across batch, micro-batch, near real-time, and streaming workloads.
• Act as the technical authority for Azure and Microsoft data technologies, providing hands-on expertise across Microsoft Fabric, Databricks, Power BI, Microsoft Purview, and associated data platform services.
• Define and enforce data engineering, modelling, and delivery standards, including conceptual, logical and physical data models, pipeline development practices, testing frameworks, DevOps automation, CI/CD, security, documentation, and release management.
• Collaborate with academic and professional teams to achieve organisational objectives.

For further details on role responsibilities and skills & experience required, please refer to the position description at the top of this career page.

What makes you perfect for the role?

To be successful in this role, you will demonstrate:

• Extensive experience in the design, development, and operation of modern cloud-based data platforms, pipelines and integrations using Microsoft Azure and Microsoft Fabric technologies.
• Deep expertise designing Lakehouses and Data Warehouses using the Medallion architecture. Strong proficiency in Delta Lake storage formats, optimization, and managing DirectLake mode performance for Power BI.
• Expertise in orchestrating complex data pipelines using Fabric Data Factory and writing optimised PySpark/SQL notebooks for large-scale data transformation.
• Proven experience implementing DevOps practices within Fabric, including Git integration, deployment pipelines
• Excellent organisational and time management abilities.
• The ability to work independently as well as collaboratively within a team.
• A commitment to diversity, inclusion, and providing an outstanding student experience.

The good stuff

At UNSW College, you'll become part of a collaborative and supportive community dedicated to helping students achieve their goals. We offer:

• Enhanced Parental leave
• Access to Fitness Passport, and UNSW Fitness & Aquatic Centre, colleague discounts
• UNSW Training
• Novated leasing (pay your car lease out of your salary through a combination of pre-tax and post-tax salary deductions)
• Christmas leave (3 additional days during the University shutdown/Christmas period)

UNSW College values diversity and encourages applications from people of all backgrounds, experiences, and identities. We are committed to providing an inclusive and equitable workplace where everyone can thrive.

Please note that we may be reviewing applications on a rolling basis