Senior Data Engineer: Azure/Databricks Platform Lead

UNSW Employees, Location, Alumni; Randwick City Council; Hybrid; AUD 119,000 - 146,000; Full time

Benefits offered by this job

WFH Flexibility

Flexible working hours

17% Superannuation

Job summary

UNSW Enterprise Data Office (EDO) seeks a Senior Data Engineer for the Admissions Transformation Project. You will design, build, and support data pipelines on UNSW’s data platform, focusing on ingestion, transformation, and reliable deployments to enable analysis and governance.

Reporting to the Senior Manager, Insights Analytics & Data, you will mentor the EDO team and collaborate with internal and external stakeholders.

Qualifications

• 5+ years hands-on data engineering experience; MS Azure and Databricks expertise a strong advantage.
• Experience with synchronous and asynchronous data integration patterns (API, ELT, ETL).
• Deep expertise in SQL, Python/PySpark, Unity Catalog, and Azure data services.

Responsibilities

• Lead the technical development of a high-performing team across analytics, data integration, and platform services through coaching and collaboration.
• Provide technical support to deliver accurate admissions dashboards and reports with stakeholders.
• Design, develop, and implement a large-scale, high-performance data platform for ingestion, storage, processing, and orchestration.

Skills

Azure

Databricks

Python

SQL

DevOps

CI/CD

Data modelling

Data governance

Stakeholder communication

Education

Tertiary IT qualification

Tools

Microsoft Azure

Databricks

Terraform

Snowflake

Git

JIRA

Confluence

DevOps

AWS

Job description

UNSW Enterprise Data Office (EDO) seeks a Senior Data Engineer for the Admissions Transformation Project. You will design, build, and support data pipelines on UNSW’s data platform, focusing on ingestion, transformation, and reliable deployments to enable analysis and governance.

Reporting to the Senior Manager, Insights Analytics & Data, you will mentor the EDO team and collaborate with internal and external stakeholders.