Senior Data Engineer - AI-Driven Data Pipelines on Fabric

AustralianSuper Pty Ltd; Melbourne; Hybrid; AUD 120,000 - 170,000; Full time

Benefits offered by this job

Hybrid work model

Job summary

AustralianSuper is seeking a Senior Data Engineer to design and build AI-enabled data platforms. You will work with Microsoft Fabric, Python, Spark and SQL on large-scale enterprise data, shaping the next generation of data capabilities.

Youll have opportunities to lead, coach others and drive governance and security into scalable solutions. The role emphasizes collaboration with business stakeholders, modern DevOps practices and ongoing learning in a hybrid, flexible environment, with a focus

Qualifications

• Extensive data engineering experience in enterprise environments.
• Hands-on Fabric experience; Databricks/Synapse and Spark knowledge are a plus.
• Strong Python, Spark and SQL engineering capabilities.
• Experience applying AI in modern data engineering contexts.
• Designing robust, scalable data solutions with large datasets.
• Excellent communication with technical and business stakeholders.
• DevOps/CI/CD experience and Azure DevOps familiarity.
• Understanding of data security, privacy and governance.

Responsibilities

• Own end-to-end design and delivery of scalable data pipelines and models.
• Apply AI and agentic approaches to accelerate data engineering and code development.
• Work with large, complex datasets to deliver reliable data solutions.
• Embed security, privacy, data quality and governance controls.
• Build engineering capability through DevOps, CI/CD and standards.
• Partner with stakeholders to shape requirements and manage expectations.
• Provide technical leadership and coaching to the team.

Skills

Python

Spark

SQL

Data modelling

DevOps

Stakeholder comms

Tools

Microsoft Fabric

Databricks

Synapse

Azure DevOps

Job description

AustralianSuper is seeking a Senior Data Engineer to design and build AI-enabled data platforms. You will work with Microsoft Fabric, Python, Spark and SQL on large-scale enterprise data, shaping the next generation of data capabilities.

Youll have opportunities to lead, coach others and drive governance and security into scalable solutions. The role emphasizes collaboration with business stakeholders, modern DevOps practices and ongoing learning in a hybrid, flexible environment, with a focus