Senior Data Engineer - ATP

University of New South Wales; Sydney; On-site; AUD 119,000 - 146,000; Full time

Benefits offered by this job

Flexible Working Options

3 days leave during December festive

Up to 50% discount on UNSW courses

Flexible 17% Superannuation

Salary sacrifice

Job summary

University of New South Wales in Kensington, NSW is seeking a Senior Data Engineer to design, build and support high‑performing data pipelines on UNSW’s data platform, enabling reliable ingestion, processing and visualization to support admissions insights and reporting for governance and leadership.

Reporting to the Senior Manager, Insight Analytics & Data, you will mentor the EDO team, collaborate with stakeholders, and lead architecture decisions for a scalable Azure‑Databricks platform while

Qualifications

• 5+ years hands-on experience in data engineering with MS Azure and Databricks.
• Experience with API, ELT and ETL integration patterns.
• Deep expertise in Databricks and Microsoft Azure.
• Proficient in SQL, Python/PySpark, Unity Catalog and Azure data services.
• Experience with Azure DevOps and CI/CD for data solutions.
• Knowledge of TEQSA, TCSI and QILT reporting requirements.

Responsibilities

• Lead the technical development of a high-performing analytics and data team.
• Provide coaching, mentoring and foster collaboration across units.
• Design, build and implement scalable data platform architectures.
• Guide developers and coordinate with stakeholders and suppliers.
• Analyse requirements to align functional and non-functional needs.
• Manage risks, issues and financials with proactive solutions.
• Evaluate new technologies to improve data ingestion, processing and analytics.
• Support leadership in optimising pipelines and dashboards.

Skills

Azure Databricks

Data modelling

SQL

Python/PySpark

CI/CD

DevOps

Stakeholder collaboration

Education

Tertiary IT qualification

Tools

Azure DevOps

Git

Terraform

Databricks

JIRA

Confluence

Snowflake

Job description

University of New South Wales – Kensington NSW

• Employment Type: Full time position, 12-month Fixed Term position.
• Remuneration: Level 8 – from $132,445 + 17% superannuation.
• Location: Kensington, NSW. Some WFH Flexibility.

About the Role

UNSW Enterprise Data Office (EDO) builds capability in business intelligence and planning, managing robust data through its enterprise data warehouse, Information Hub, and Data and Information Governance. EDO is a strategic resource for senior University management, delivering insights, analysis, and management information. It also prepares official reports for the Commonwealth Government and other statutory bodies.

The Senior Data Engineer, Admissions Transformation Project (ATP), plays a key role in EDO - designing, building and supporting data pipelines and solutions on UNSW’s data platform. This includes data ingestion, transformation, and ensuring systems are reliable, maintainable and aligned with platform architecture and business needs.

The role combines skills in data engineering, modelling, and DevOps to ensure efficient pipelines, stable deployments, and high-performing systems, supporting effective data visualisation and stakeholder insights.

Reporting to the Senior Manager, Insight Analytics & Data, the role has no direct reports but contributes to mentoring the broader EDO team.

The successful candidate will have demonstrated experience in and be responsible for:

• Lead the technical development of a high-performing team across analytics, data integration, and platform services by providing coaching, mentoring, and cultivating a collaborative and innovative team culture.
• Provide technical support and guidance to the Insights, Analytics, and Data team to deliver accurate and effective admissions dashboards and reports. Collaborate with internal and external stakeholders throughout implementation to ensure successful and timely delivery
• Design, develop, configure, and implement a large-scale, high-performance data platform that supports data ingestion, storage, processing, orchestration, and infrastructure.
• Lead the Data Platform Architecture and Strategy, ensuring the solution is scalable, reliable, and high-performing (include but not limited to Microsoft Azure and Databricks).
• Guide developers and coordinate with internal organisational units and suppliers during implementation to ensure deliverables are met
• Analyse specific requirements and architectures to design appropriate objects and methods for implementing functional and non-functional requirements.
• Proactively manage complex risks, issues, and financials, collaborating with the team to identify and implement effective solutions.
• Evaluating and implementing new technologies and tools to improve data ingestion, data processing, storage and analysis.
• Support leadership in optimising data pipeline and dashboard efficiency by improving practices, streamlining resourcing, and implementing ongoing optimisation strategies that drive continuous improvement.

About You

• Tertiary qualifications in IT or an equivalent level of knowledge gained through any other combination of education, training and experience, with 5+ years of hands‑on experience in data engineering, with MS Azure and Databricks expertise being a strong advantage
• Experience with a diverse range of synchronous and asynchronous integration patterns (e.g., API, ELT, ETL) in appropriate settings.
• This role demands deep expertise in Databricks and Microsoft Azure.
• Proficient in data modelling, integration, and design, with hands‑on expertise in SQL, Python/PySpark, Unity Catalog, and database schema development. Skilled in designing and implementing solutions using Azure data services.
• Experience with Azure DevOps and CI/CD tools for automated testing and deployment of data related solutions and database/lakehouse changes.
• In-depth knowledge of Higher Education data frameworks and reporting requirements (e.g., TEQSA, TCSI, QILT), along with expertise in transforming student admission data and performance metrics to align with institutional objectives.
• Extensive experience in core data warehouse modelling principles including Kimball methodology, Snowflake schema, Slowly Changing Dimensions (SCD) and other industry best practices.
• Advanced written and verbal communication skills with attention to detail.
• Deep expertise in data governance, security, and privacy controls, with hands‑on experience in developing and implementing security models.
• Excellent time management skills, ability to respond to changing priorities, manage multiple tasks and meet deadlines.
• Familiarity with Agile Project Management methodologies and experience in participating in storyboarding, estimation, and using project management tools
• Knowledge of technical products like Terraform, Databricks, Snowflake, MS Azure, AWS Cloud, and productivity applications like Git, JIRA, Confluence and DevOps.

For further information on the role & responsibilities, please refer to the Position Description

Please note: Sponsorship is not available for this role, valid Australian working rights are required on application.

UNSW Benefits and Culture:

People are at the core of everything we do. We recognise it is the contributions of our staff who make UNSW one of the best universities in Australia and the world.

Our benefits include:

• Flexible Working Options (work from home, flexible hours etc)
• Additional 3 days leave during December festive period.
• Up to 50% discount on UNSW courses
• Flexible 17% Superannuation contributions, additional leave-loading payments and salary sacrifice.
• Discounts and entitlements (retail, education, fitness passport)

UNSW is committed to equity diversity and inclusion. Applications from women, people of culturally and linguistically diverse backgrounds, those living with disabilities, members of the LGBTIQ+ community; and people of Aboriginal and Torres Strait Islander descent, are encouraged. UNSW provides workplace adjustments for people with disability, and access to flexible work options for eligible staff.