Senior Data Engineer - Atp

University Of New South Wales; Randwick City Council; Hybrid; AUD 139,000 - 169,000; Full time

Benefits offered by this job

Flexible Working Options

Additional 3 days leave during Decfest

Up to 50% discount on UNSW courses

Flexible 17% Superannuation

Discounts and entitlements

Job summary

UNSW is seeking a Senior Data Engineer in Admissions Transformation Project to design, build and support high-performance data pipelines on UNSW's data platform. You will lead analytics, data integration and platform services, while mentoring the UPP team and aligning with enterprise architecture.

The role requires 5+ years in data engineering, strong Azure and Databricks skills, and fluency with SQL, Python/PySpark, and governance practices.

Qualifications

• Tertiary qualifications in IT with 5+ years hands-on data engineering experience, Azure and Databricks expertise a strong advantage.
• Deep knowledge of SQL, Python/PySpark, Unity Catalog, and Azure data services; CI/CD for data solutions.
• Experience with Azure DevOps, TEQSA/TCSI/QILT familiarity, and data governance practices.

Responsibilities

• Lead technical development of a high-performing analytics/data team with coaching and collaboration.
• Design, build and support large-scale data platform for ingestion, storage, processing and orchestration.
• Guide architecture strategy with Azure and Databricks, ensuring scalable, reliable deployments.
• Mentor stakeholders, coordinate with internal units and suppliers to meet deliverables.
• Optimize data pipelines, dashboards and governance to support insights and reporting.

Skills

MS Azure

Databricks

Python/PySpark

SQL

Data modelling

CI/CD

DevOps

Azure DevOps

Snowflake

Git/Jira/Confluence

Education

Bachelor's degree in IT or related field

Tools

Unity Catalog

Terraform

Kubernetes

Azure Data Services

Job description

Job Description

At UNSW, we take pride in the broad range and high quality of our teaching programs. Our teaching gains strength and currency from our research activities, strong industry links and our international nature; UNSW has strong regional and...

• Employment Type: Full time position, 12-month Fixed Term position.
• Remuneration: Level 9 – from $153,933 + 17% superannuation.
• Location: Kensington, NSW. Some WFH Flexibility.

About the Role

UNSW Planning and Performance (UPP) builds capability in business intelligence and planning, managing robust data through its enterprise data warehouse, Information Hub, and Data and Information Governance. UPP is a strategic resource for senior University management, delivering insights, analysis, and management information. It also prepares official reports for the Commonwealth Government and other statutory bodies.

The Senior Data Engineer, Admissions Transformation Project (ATP), plays a key role in UPP—designing, building and supporting data pipelines and solutions on UNSW's data platform. This includes data ingestion, transformation, and ensuring systems are reliable, maintainable and aligned with platform architecture and business needs.

The role combines skills in data engineering, modelling, and DevOps to ensure efficient pipelines, stable deployments, and high-performing systems, supporting effective data visualisation and stakeholder insights.

Reporting to the Senior Manager, Insight Analytics & Data, the role has no direct reports but contributes to mentoring the broader UPP team.

The successful candidate will have demonstrated experience in and be responsible for:

• Lead the technical development of a high-performing team across analytics, data integration, and platform services by providing coaching, mentoring, and cultivating a collaborative and innovative team culture.
• Provide technical support and guidance to the Insights, Analytics, and Data team to deliver accurate and effective admissions dashboards and reports. Collaborate with internal and external stakeholders throughout implementation to ensure successful and timely delivery
• Design, develop, configure, and implement a large-scale, high-performance data platform that supports data ingestion, storage, processing, orchestration, and infrastructure.
• Lead the Data Platform Architecture and Strategy, ensuring the solution is scalable, reliable, and high-performing (include but not limited to Microsoft Azure and Databricks).
• Guide developers and coordinate with internal organisational units and suppliers during implementation to ensure deliverables are met
• Analyse specific requirements and architectures to design appropriate objects and methods for implementing functional and non-functional requirements.
• Proactively manage complex risks, issues, and financials, collaborating with the team to identify and implement effective solutions.
• Evaluating and implementing new technologies and tools to improve data ingestion, data processing, storage and analysis.
• Support leadership in optimising data pipeline and dashboard efficiency by improving practices, streamlining resourcing, and implementing ongoing optimisation strategies that drive continuous improvement.

About You

• Tertiary qualifications in IT or an equivalent level of knowledge gained through any other combination of education, training and experience, with 5+ years of hands‑on experience in data engineering, with MS Azure and Databricks expertise being a strong advantage
• Experience with a diverse range of synchronous and asynchronous integration patterns (e.g., API, ELT, ETL) in appropriate settings.
• This role demands deep expertise in Databricks and Microsoft Azure.
• Proficient in data modelling, integration, and design, with hands‑on expertise in SQL, Python/PySpark, Unity Catalog, and database schema development. Skilled in designing and implementing solutions using Azure data services.
• Experience with Azure DevOps and CI/CD tools for automated testing and deployment of data related solutions and database/lakehouse changes.
• In‑depth knowledge of Higher Education data frameworks and reporting requirements (e.g., TEQSA, TCSI, QILT), along with expertise in transforming student admission data and performance metrics to align with institutional objectives.
• Extensive experience in core data warehouse modelling principles including Kimball methodology, Snowflake schema, Slowly Changing Dimensions (SCD) and other industry best practices.
• Advanced written and verbal communication skills with attention to detail.
• Deep expertise in data governance, security, and privacy controls, with hands‑on experience in developing and implementing security models.
• Excellent time management skills, ability to respond to changing priorities, manage multiple tasks and meet deadlines.
• Familiarity with Agile Project Management methodologies and experience in participating in storyboarding, estimation, and using project management tools
• Knowledge of technical products like Terraform, Databricks, Snowflake, MS Azure, AWS Cloud, and productivity applications like Git, JIRA, Confluence and DevOps.

Please note: Sponsorship is not available for this role, valid Australian working rights are required on application.

UNSW Benefits and Culture:

People are at the core of everything we do. We recognise it is the contributions of our staff who make UNSW one of the best universities in Australia and the world. Our benefits include:

• Flexible Working Options (work from home, flexible hours etc)
• Additional 3 days leave during December festive period.
• Up to 50% discount on UNSW courses
• Flexible 17% Superannuation contributions, additional leave-loading payments and salary sacrifice.
• Discounts and entitlements (retail, education, fitness passport)

UNSW is committed to equity diversity and inclusion. Applications from women, people of culturally and linguistically diverse backgrounds, those living with disabilities, members of the LGBTIQ+ community; and people of Aboriginal and Torres Strait Islander descent, are encouraged. UNSW provides workplace adjustments for people with disability, and access to flexible work options for eligible staff.