Lead Data Engineer – Azure Databricks Platform

AIA Shared Services

City of Melbourne

On-site

AUD 170,000 - 210,000

Full time

6 days ago

Be an early applicant

Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

Flexible working

Health initiatives

Training access

Career development

Job summary

AIA Australia is undergoing a major technology and data transformation, building a modern platform on Azure Databricks. You will lead data engineering efforts, oversee onshore/offshore engineers, and drive data migration from legacy systems to cloud-native solutions.

Based in Sydney or Melbourne, this role blends hands-on coding with technical leadership and stakeholder collaboration. Join a global insurer transforming data platforms, enabling faster, simpler, and more connected data products

Qualifications

Proven hands-on experience with Databricks, data modelling, and ETL processes.
Experience with Python and SQL.
Azure cloud platform and data services like ADF, ADLS, SQL.
Strong leadership and mentoring abilities.
Databricks certification is a plus.

Responsibilities

Define detailed technical solution and manage delivery for the data engineering team (onshore and offshore).
Lead data modelling, ETL automation, DevOps, data quality and performance optimisation on Azure Databricks.
Collaborate with Business, Analytics, IT, and vendors to align data engineering with business priorities.
Mentor and upskill data engineers and analysts in Azure Databricks tooling.