Senior Data Engineer - ATP

University of New South Wales; Penrith City Council; On-site; AUD 139,000 - 169,000; Full time

Benefits offered by this job

Flexible Working Options

3 days leave during December festive

UNSW course discounts

Flexible superannuation contributions

Job summary

UNSW Planning and Performance (UPP) seeks a Senior Data Engineer for the Admissions Transformation Project to design, build, and support data pipelines on UNSW’s data platform. You will lead analytics, data integration, and platform services, enabling robust stakeholders insights.

Senior Data Engineer will guide the Data Platform Architecture, ensure scalable, reliable deployments, and contribute to mentoring the UPP team.

Qualifications

• 5+ years hands-on data engineering experience.
• Deep expertise in Databricks and Microsoft Azure.
• Strong SQL, Python/PySpark, and data modelling skills.
• Experience with Azure data services and DevOps CI/CD.
• Knowledge of TEQSA/TCSI/QILT reporting frameworks.
• Familiarity with data governance, security, and privacy controls.

Responsibilities

• Lead the technical development of analytics, data integration, and platform services.
• Provide guidance to deliver admissions dashboards and reports.
• Design and implement a large-scale data platform for ingestion, storage and processing.
• Drive Data Platform Architecture and Strategy for scalability and reliability.
• Mentor team members and coordinate with internal units and suppliers.

Skills

MS Azure

Databricks

SQL

Python/PySpark

Unity Catalog

Azure DevOps

CI/CD

Data modelling

Data governance

Terrafrom

Education

Tertiary IT qualification

Tools

Git

JIRA

Confluence

Job description

At UNSW, we take pride in the broad range and high quality of our teaching programs. Our teaching gains strength and currency from our research activities, strong industry links and our international nature; UNSW has strong regional and...

• Employment Type: Full time position, 12-month Fixed Term position.
• Remuneration: Level 9 – from $153,933 + 17% superannuation.
• Location: Kensington, NSW. Some WFH Flexibility.

About the Role

UNSW Planning and Performance (UPP) builds capability in business intelligence and planning, managing robust data through its enterprise data warehouse, Information Hub, and Data and Information Governance. UPP is a strategic resource for senior University management, delivering insights, analysis, and management information. It also prepares official reports for the Commonwealth Government and other statutory bodies.

The Senior Data Engineer, Admissions Transformation Project (ATP), plays a key role in UPP—designing, building and supporting data pipelines and solutions on UNSW’s data platform. This includes data ingestion, transformation, and ensuring systems are reliable, maintainable and aligned with platform architecture and business needs.

The role combines skills in data engineering, modelling, and DevOps to ensure efficient pipelines, stable deployments, and high-performing systems, supporting effective data visualisation and stakeholder insights.

Reporting to the Senior Manager, Insight Analytics & Data, the role has no direct reports but contributes to mentoring the broader UPP team.

The successful candidate will have demonstrated experience in and be responsible for:

• Lead the technical development of a high-performing team across analytics, data integration, and platform services by providing coaching, mentoring, and cultivating a collaborative and innovative team culture.
• Provide technical support and guidance to the Insights, Analytics, and Data team to deliver accurate and effective admissions dashboards and reports. Collaborate with internal and external stakeholders throughout implementation to ensure successful and timely delivery
• Design, develop, configure, and implement a large-scale, high-performance data platform that supports data ingestion, storage, processing, orchestration, and infrastructure.
• Lead the Data Platform Architecture and Strategy, ensuring the solution is scalable, reliable, and high-performing (include but not limited to Microsoft Azure and Databricks).
• Guide developers and coordinate with internal organisational units and suppliers during implementation to ensure deliverables are met
• Analyse specific requirements and architectures to design appropriate objects and methods for implementing functional and non-functional requirements.
• Proactively manage complex risks, issues, and financials, collaborating with the team to identify and implement effective solutions.
• Evaluating and implementing new technologies and tools to improve data ingestion, data processing, storage and analysis.
• Support leadership in optimising data pipeline and dashboard efficiency by improving practices, streamlining resourcing, and implementing ongoing optimisation strategies that drive continuous improvement.

About You

• Tertiary qualifications in IT or an equivalent level of knowledge gained through any other combination of education, training and experience, with 5+ years of hands-on experience in data engineering, with MS Azure and Databricks expertise being a strong advantage
• Experience with a diverse range of synchronous and asynchronous integration patterns (e.g., API, ELT, ETL) in appropriate settings.
• This role demands deep expertise in Databricks and Microsoft Azure.
• Proficient in data modelling, integration, and design, with hands-on expertise in SQL, Python/PySpark, Unity Catalog, and database schema development. Skilled in designing and implementing solutions using Azure data services.
• Experience with Azure DevOps and CI/CD tools for automated testing and deployment of data related solutions and database/lakehouse changes.
• In-depth knowledge of Higher Education data frameworks and reporting requirements (e.g., TEQSA, TCSI, QILT), along with expertise in transforming student admission data and performance metrics to align with institutional objectives.
• Extensive experience in core data warehouse modelling principles including Kimball methodology, Snowflake schema, Slowly Changing Dimensions (SCD) and other industry best practices.
• Advanced written and verbal communication skills with attention to detail.
• Deep expertise in data governance, security, and privacy controls, with hands-on experience in developing and implementing security models.
• Excellent time management skills, ability to respond to changing priorities, manage multiple tasks and meet deadlines.
• Familiarity with Agile Project Management methodologies and experience in participating in storyboarding, estimation, and using project management tools
• Knowledge of technical products like Terraform, Databricks, Snowflake, MS Azure, AWS Cloud, and productivity applications like Git, JIRA, Confluence and DevOps.

For further information on the role & responsibilities, please refer to the Position Description

Please note: Sponsorship is not available for this role, valid Australian working rights are required on application.

UNSW Benefits and Culture:

People are at the core of everything we do. We recognise it is the contributions of our staff who make UNSW one of the best universities in Australia and the world. Our benefits include:

• Flexible Working Options (work from home, flexible hours etc)
• Additional 3 days leave during December festive period.
• Up to 50% discount on UNSW courses
• Flexible 17% Superannuation contributions, additional leave-loading payments and salary sacrifice.
• Discounts and entitlements (retail, education, fitness passport)

UNSW is committed to equity diversity and inclusion. Applications from women, people of culturally and linguistically diverse backgrounds, those living with disabilities, members of the LGBTIQ+ community; and people of Aboriginal and Torres Strait Islander descent, are encouraged. UNSW provides workplace adjustments for people with disability, and access to flexible work options for eligible staff.