Senior Data Engineer - ATP

UNSW; Sydney; Hybrid; AUD 113,000 - 139,000; Full time

Benefits offered by this job

Flexible Working Options

Up to 50% UNSW course discount

Flexible 17% Superannuation

Job summary

UNSW is seeking a Senior Data Engineer for the Admissions Transformation Project. You will design, build, and support high-performance data pipelines on UNSW’s data platform, enabling robust data ingestion, transformation, and reliable deployments.

Reporting to the Senior Manager, Insights Analytics & Data, you will mentor the EDO team and collaborate with stakeholders to deliver accurate dashboards and insights for admissions. Strong Azure and Databricks expertise is essential.

Qualifications

• 5+ years hands-on data engineering with MS Azure and Databricks.
• Experience with API, ELT/ETL integration patterns.
• Deep expertise in Databricks and Microsoft Azure.
• Proficient in SQL, Python/PySpark, and Azure data services.

Responsibilities

• Lead technical development of a high-performing analytics team.
• Deliver admissions dashboards and reports with stakeholders.
• Design and implement a large-scale data platform (ingestion, storage, processing).
• Guide platform architecture, ensure scalability, reliability, and performance.
• Coordinate with internal units and external suppliers to meet deliverables.
• Manage risks, issues, and financials; drive continuous improvement.

Skills

Databricks

Azure

SQL

Python/PySpark

Azure DevOps

CI/CD

Data modelling

Data governance

Snowflake

Terraform

Git/JIRA/Confluence

Education

IT degree

Tools

Azure

Databricks

Snowflake

AWS Cloud

Terraform

Git

JIRA

Confluence

Job description

• Employment Type: Full time position, 12-month Fixed Term position.
• Remuneration: Level 8 – from $132,445 + 17% superannuation.
• Location: Kensington, NSW. Some WFH Flexibility.

This Job is based in Australia

• Employment Type: Full time position, 12-month Fixed Term position.
• Remuneration: Level 8 – from $132,445 + 17% superannuation.
• Location: Kensington, NSW. Some WFH Flexibility.

About The Role

UNSW Enterprise Data Office (EDO) builds capability in business intelligence and planning, managing robust data through its enterprise data warehouse, Information Hub, and Data and Information Governance. EDO is a strategic resource for senior University management, delivering insights, analysis, and management information. It also prepares official reports for the Commonwealth Government and other statutory bodies.

The Senior Data Engineer, Admissions Transformation Project (ATP), plays a key role in EDO - designing, building and supporting data pipelines and solutions on UNSW’s data platform. This includes data ingestion, transformation, and ensuring systems are reliable, maintainable and aligned with platform architecture and business needs.

The role combines skills in data engineering, modelling, and DevOps to ensure efficient pipelines, stable deployments, and high-performing systems, supporting effective data visualisation and stakeholder insights.

Reporting to the Senior Manager, Insight Analytics & Data, the role has no direct reports but contributes to mentoring the broader EDO team.

The successful candidate will have demonstrated experience in and be responsible for:

• Lead the technical development of a high-performing team across analytics, data integration, and platform services by providing coaching, mentoring, and cultivating a collaborative and innovative team culture.
• Provide technical support and guidance to the Insights, Analytics, and Data team to deliver accurate and effective admissions dashboards and reports. Collaborate with internal and external stakeholders throughout implementation to ensure successful and timely delivery
• Design, develop, configure, and implement a large-scale, high-performance data platform that supports data ingestion, storage, processing, orchestration, and infrastructure.
• Lead the Data Platform Architecture and Strategy, ensuring the solution is scalable, reliable, and high-performing (include but not limited to Microsoft Azure and Databricks).
• Guide developers and coordinate with internal organisational units and suppliers during implementation to ensure deliverables are met
• Analyse specific requirements and architectures to design appropriate objects and methods for implementing functional and non-functional requirements.
• Proactively manage complex risks, issues, and financials, collaborating with the team to identify and implement effective solutions.
• Evaluating and implementing new technologies and tools to improve data ingestion, data processing, storage and analysis.
• Support leadership in optimising data pipeline and dashboard efficiency by improving practices, streamlining resourcing, and implementing ongoing optimisation strategies that drive continuous improvement.

About You

• Tertiary qualifications in IT or an equivalent level of knowledge gained through any other combination of education, training and experience, with 5+ years of hands‑on experience in data engineering, with MS Azure and Databricks expertise being a strong advantage
• Experience with a diverse range of synchronous and asynchronous integration patterns (e.g., API, ELT, ETL) in appropriate settings.
• This role demands deep expertise in Databricks and Microsoft Azure.
• Proficient in data modelling, integration, and design, with hands‑on expertise in SQL, Python/PySpark, Unity Catalog, and database schema development. Skilled in designing and implementing solutions using Azure data services.
• Experience with Azure DevOps and CI/CD tools for automated testing and deployment of data related solutions and database/lakehouse changes.
• In‑depth knowledge of Higher Education data frameworks and reporting requirements (e.g., TEQSA, TCSI, QILT), along with expertise in transforming student admission data and performance metrics to align with institutional objectives.
• Extensive experience in core data warehouse modelling principles including Kimball methodology, Snowflake schema, Slowly Changing Dimensions (SCD) and other industry best practices.
• Advanced written and verbal communication skills with attention to detail.
• Deep expertise in data governance, security, and privacy controls, with hands‑on experience in developing and implementing security models.
• Excellent time management skills, ability to respond to changing priorities, manage multiple tasks and meet deadlines.
• Familiarity with Agile Project Management methodologies and experience in participating in storyboarding, estimation, and using project management tools
• Knowledge of technical products like Terraform, Databricks, Snowflake, MS Azure, AWS Cloud, and productivity applications like Git, JIRA, Confluence and DevOps.

For further information on the role & responsibilities, please refer to the Position Description

UNSW Benefits and Culture

People are at the core of everything we do. We recognise it is the contributions of our staff who make UNSW one of the best universities in Australia and the world. Our benefits include:

• Flexible Working Options (work from home, flexible hours etc)
• Additional 3 days leave during December festive period.
• Career development opportunities
• Up to 50% discount on UNSW courses
• Flexible 17% Superannuation contributions, additional leave-loading payments and salary sacrifice.
• Discounts and entitlements (retail, education, fitness passport)

Please note: Sponsorship is not available for this role, valid Australian working rights are required on application.

UNSW is committed to equity diversity and inclusion. Applications from women, people of culturally and linguistically diverse backgrounds, those living with disabilities, members of the LGBTIQ+ community; and people of Aboriginal and Torres Strait Islander descent, are encouraged. UNSW provides workplace adjustments for people with disability, and access to flexible work options for eligible staff.