Technical Lead - Data Engineering (Azure Databricks)

AIA Australia; Melbourne; On-site; AUD 180,000 - 240,000; Full time

Benefits offered by this job

Training & development

Internal mobility

Health & wellbeing initiatives

Flexible working

Job summary

AIA Australia is executing a major technology, data and business transformation program. We are building a new modern platform on Azure Databricks and seeking a Technical Lead - Data Engineering to guide data migration from legacy systems and lead onshore/offshore engineers.

The role reports to the Head of Data Platforms and Analytics and can be based in Sydney or Melbourne. You will define detailed solutions, design scalable data frameworks, ensure data quality and security, and mentor a team

Qualifications

• Extensive hands-on data engineering and detailed design experience.
• Experience in insurance, banking or financial services is preferred.
• Proficiency with Python and SQL.
• Experience with Azure cloud services (ADF, ADLS, SQL).
• Ability to mentor and lead a team of engineers.

Responsibilities

• Define a detailed technical solution and manage delivery for the data engineering team.
• Design, build and maintain scalable data ingestion, curation and transformation using Azure Databricks.
• Oversee data modelling, ETL automation, DevOps, data quality and security.
• Collaborate with Business, Analytics, IT and vendors to align data work with priorities.
• Mentor and upskill engineers in Azure Databricks.

Skills

Data engineering

Azure Databricks

Python

SQL

Leadership

Mentoring

Tools

Azure Databricks

Azure Data Factory

Azure Data Lake Storage

Python

SQL

Job description

AIA Australia is executing a major technology, data and business transformation program. We are building a new modern platform on Azure Databricks and seeking a Technical Lead - Data Engineering to guide data migration from legacy systems and lead onshore/offshore engineers.

The role reports to the Head of Data Platforms and Analytics and can be based in Sydney or Melbourne. You will define detailed solutions, design scalable data frameworks, ensure data quality and security, and mentor a team