Data Engineering Lead — Azure Databricks

AIA; Sydney; On-site; AUD 180,000 - 240,000; Full time

Benefits offered by this job

Flexible working arrangement

Health and wellbeing initiatives

Training and development programs

Job summary

AIA Australia is undergoing a major technology and data transformation. We seek a Technical Lead - Data Engineering to drive data migration to Azure Databricks, oversee onshore and offshore engineers, and design scalable data products aligned with business goals.

You will mentor the team, shape engineering practices, and collaborate with Business, Analytics and IT stakeholders to deliver robust data platforms. Sydney or Melbourne base preferred.

Qualifications

• Extensive hands-on data engineering and detailed design experience.

Responsibilities

• Take full responsibility for defining a detailed technical solution and managing technical delivery of the data engineering team (onshore and offshore) based on detailed Business Requirements and aligned to the high level solution architecture data
• Design, Build and maintain scalable and efficient detailed design and frameworks using Azure Databricks for ingestion, curation and transformation of data
• Responsible for data modelling, ETL automation, DevOps, data quality, data security and performance optimization leveraging best practices of Azure cloud platform
• Work collaboratively with key stakeholders across Business, Analytics, IT teams (local and offshore) and vendors, ensuring alignment of data engineering efforts with business priorities
• Mentor and support a team of data engineers and analysts, in development of best engineering practice and upskilling engineers in Azure databricks toolset

Skills

Databricks

Python

SQL

Azure

Data modelling

ETL automation

DevOps

Data quality

Data security

Leadership

Tools

Azure Databricks

ADF

ADLS

Job description

AIA Australia is undergoing a major technology and data transformation. We seek a Technical Lead - Data Engineering to drive data migration to Azure Databricks, oversee onshore and offshore engineers, and design scalable data products aligned with business goals.

You will mentor the team, shape engineering practices, and collaborate with Business, Analytics and IT stakeholders to deliver robust data platforms. Sydney or Melbourne base preferred.