Technical Lead - Data Engineering

AIA Shared Services; City of Melbourne; On-site; AUD 170,000 - 210,000; Full time

Benefits offered by this job

Flexible working

Health initiatives

Training access

Career development

Job summary

AIA Australia is undergoing a major technology and data transformation, building a modern platform on Azure Databricks. You will lead data engineering efforts, oversee onshore/offshore engineers, and drive data migration from legacy systems to cloud-native solutions.

Based in Sydney or Melbourne, this role blends hands-on coding with technical leadership and stakeholder collaboration. Join a global insurer transforming data platforms, enabling faster, simpler, and more connected data products

Qualifications

• Proven hands-on experience with Databricks, data modelling, and ETL processes.
• Experience with Python and SQL.
• Azure cloud platform and data services like ADF, ADLS, SQL.
• Strong leadership and mentoring abilities.
• Databricks certification is a plus.

Responsibilities

• Define detailed technical solution and manage delivery for the data engineering team (onshore and offshore).
• Lead data modelling, ETL automation, DevOps, data quality and performance optimisation on Azure Databricks.
• Collaborate with Business, Analytics, IT, and vendors to align data engineering with business priorities.
• Mentor and upskill data engineers and analysts in Azure Databricks tooling.

Skills

Leadership

Mentoring

Communication

Problem solving

Tools

Databricks

Azure Data Factory

Azure Data Lake Storage

SQL

Python

Job description

Technical Lead – Data Engineering – AIA Australia

BE THE DIFFERENCE At AIA we don’t simply believe in being ‘the best’. We believe in better – because there’s no limit to how far ‘better’ can take us. Everything we do is driven by our purpose to make a difference by helping people embrace Healthier, Longer, Better Lives. And every one of our people has an important part role to play. If you want to make a difference by helping shape a healthier, better-protected Australia, read on.

The Opportunity

AIA Australia is currently undergoing a large technology, data and business transformation program resulting in refreshing the technology blueprint and the introduction of contemporary ways of working with the aim of creating a simpler, faster more connected organisation. AIA is building a new modern platform using Azure Databricks. We are seeking a highly skilled and experienced Technical Lead – Data Engineering to join our Data Engineering team and lead data migration from legacy on‑prem Data warehouse systems to Azure Databricks solutions. This program of work will present both significant challenges and rewards, pushing your technical abilities and nurturing you to evolve into a data superhero. As a Technical Lead – Data Engineering, you will lead detailed technical design and do hands‑on development along with overseeing development from onshore and offshore based data engineers to build robust, and scalable data products, aligned with our business objectives. This role is reporting into the Head of Data Platforms and Analytics and can be based in either Sydney or Melbourne.

Responsibilities

• Take full responsibility for defining a detailed technical solution and managing technical delivery of the data engineering team (onshore and offshore) based on detailed Business Requirements and aligned to the high-level solution architecture data Design, Build and maintain scalable and efficient detailed design and frameworks using Azure Databricks for ingestion, curation and transformation of data
• Responsible for data modelling, ETL automation, DevOps, data quality, data security and performance optimisation leveraging best practices of Azure cloud platform
• Work collaboratively with key stakeholders across Business, Analytics, IT teams (local and offshore) and vendors, ensuring alignment of data engineering efforts with business priorities
• Mentor and support a team of data engineers and analysts, in development of best engineering practice and upskilling engineers in Azure databricks toolset

Location: Sydney or Melbourne.

Requirements

• Extensive previous data design related experience including hands‑on Data engineering and detailed design, preferably in insurance, banking or financial services industry
• Demonstrated hands‑on experience with developing and implementing data engineering and architecture frameworks and processes using Databricks, data modelling, and automation of ETL processes
• Demonstrated proficiency with the use of relevant programming languages, tools, and technologies such as Python and SQL
• Experience with Azure cloud platform and their data services like ADF, ADLS, SQL
• Strong problem‑solving skills with the ability to analyse complex technical issues and propose effective solutions
• Excellent communication skills with the ability to convey technical concepts to both technical and non-technical stakeholders
• Strong leadership skills, including the ability to mentor, coach, and develop a high‑performing data engineering team
• Certification in Databricks will be highly regarded
• Knowledge of/or previous engineering experience within the Insurance industry would be highly regarded

Why choose AIA

At AIA, we’ve made a promise to help people live healthier, longer, better lives. And it starts with our own people.

• Access our training and development to build on your current skills
• Career development through internal mobility opportunities
• Work for a business helping millions of Australians and make a difference to someone’s life everyday
• Access additional leave days a year to recharge and refresh yourself
• Enjoy wonderful Health and Wellbeing initiatives that support you
• Work with supportive and inclusive working environment
• Flexible working arrangement

At AIA Australia, we’re proud to help guide, support and protect the wellbeing of over 3.5 million Australians. Through life and health insurance, financial wellbeing and our total wellbeing ecosystem that includes AIA Vitality - the world’s leading science-backed wellbeing programme - we’ve started a movement to make Australia the healthiest, best protected nation in the world. As part of the AIA Group - the largest independent publicly listed pan-Asian life insurance group with a presence in 18 markets in Asia-Pacific - it is our ambition to engage one billion people to live Healthier, Longer, Better Lives by 2030. Lots of companies like to say they’re different. What makes us truly different at AIA, is the difference we make in people’s lives. AIA is different. Are you? Bring your ambition, experience and ideas to AIA, and help shape what "better" looks like.