Technical Lead - Data Engineering

AIA; City of Melbourne; On-site; AUD 150,000 - 190,000; Full time

Job summary

AIA Australia is embarking on a major technology, data and business transformation. We are building a modern platform on Azure Databricks and seek a Technical Lead - Data Engineering to guide the migration of legacy data warehouses to modern data products.

You will lead onshore and offshore data engineers, design scalable data solutions, and mentor a high-performing team, reporting to the Head of Data Platforms and Analytics. Melbourne or Sydney-based with hybrid options.

Qualifications

• Extensive previous data design related experience including hands-on Data engineering and detailed design, preferably in insurance, banking or financial services industry.
• Demonstrated hands-on experience with developing and implementing data engineering and architecture frameworks and processes using Databricks, data modelling, and automation of ETL processes.
• Demonstrated proficiency with programming languages, such as Python and SQL.
• Experience with Azure cloud platform and their data services like ADF, ADLS, SQL.
• Strong problem-solving skills with the ability to analyze complex technical issues and propose effective solutions.
• Excellent communication skills with the ability to convey technical concepts to both technical and non-technical stakeholders.
• Strong leadership skills, including the ability to mentor, coach, and develop a high-performing data engineering team.
• Certification in Databricks will be highly regarded.
• Knowledge of/previous engineering experience within the Insurance industry would be highly regarded.

Responsibilities

• Define a detailed technical solution and manage technical delivery of the data engineering team (onshore and offshore) based on detailed Business Requirements and aligned to the high level solution architecture data.
• Design, Build and maintain scalable and efficient detailed design and frameworks using Azure Databricks for ingestion, curation and transformation of data.
• Responsible for data modelling, ETL automation, DevOps, data quality, data security and performance optimization leveraging best practices of Azure cloud platform.
• Collaborate with key stakeholders across Business, Analytics, IT teams (local and offshore) and vendors, ensuring alignment of data engineering efforts with business priorities.
• Mentor and support a team of data engineers and analysts, in development of best engineering practice and upskilling engineers in Azure databricks toolset.

Skills

Python

SQL

Data modelling

ETL design

Leadership

Mentoring

Communication

Problem solving

Tools

Databricks

Azure Data Factory

Azure Data Lake Storage

Azure

Job description

At AIA we don’t simply believe in being ‘the best’. We believe in better – because there’s no limit to how far ‘better’ can take us. Everything we do is driven by our purpose to make a difference by helping people embrace Healthier, Longer, Better Lives. And every one of our people has an important part role to play. If you want to make a difference by helping shape a healthier, better-protected Australia, read on.

The Opportunity:

AIA Australia is currently undergoing a large technology, data and business transformation program resulting in refreshing the technology blueprint and the introduction of contemporary ways of working with the aim of creating a simpler, faster more connected organisation.

AIA is building a new modern platform using Azure Databricks. We are seeking a highly skilled and experienced Technical Lead - Data Engineering to join our Data Engineering team and lead data migration from legacy on-prem Data warehouse systems to Azure Databricks solutions.

This program of work will present both significant challenges and rewards, pushing your technical abilities and nurturing you to evolve into a data superhero. As a Technical Lead - Data Engineering, you will lead detailed technical design and do hands-on development along with overseeing development from onshore and offshore based data engineers to build robust, and scalable data products, aligned with our business objectives.

This role is reporting into the Head of Data Platforms and Analytics and can be based in either Sydney or Melbourne.

The successful candidate would be responsible for:

• Take full responsibility for defining a detailed technical solution and managing technical delivery of the data engineering team (onshore and offshore) based on detailed Business Requirements and aligned to the high level solution architecture data
• Design, Build and maintain scalable and efficient detailed design and frameworks using Azure Databricks for ingestion, curation and transformation of data
• Responsible for data modelling, ETL automation, DevOps, data quality, data security and performance optimization leveraging best practices of Azure cloud platform
• Work collaboratively with key stakeholders across Business, Analytics, IT teams (local and offshore) and vendors, ensuring alignment of data engineering efforts with business priorities
• Mentor and support a team of data engineers and analysts, in development of best engineering practice and upskilling engineers in Azure databricks toolset

To be successful in this position, you will have:

• Extensive previous data design related experience including hands-on Data engineering and detailed design, preferably in insurance, banking or financial services industry
• Demonstrated hands-on experience with developing and implementing data engineering and architecture frameworks and processes using Databricks, data modelling, and automation of ETL processes
• Demonstrated proficiency with the use of relevant programming languages, tools, and technologies such as Python and SQL
• Experience with Azure cloud platform and their data services like ADF, ADLS, SQL
• Strong problem-solving skills with the ability to analyze complex technical issues and propose effective solutions
• Excellent communication skills with the ability to convey technical concepts to both technical and non-technical stakeholders
• Strong leadership skills, including the ability to mentor, coach, and develop a high-performing data engineering team
• Certification in Databricks will be highly regarded
• Knowledge of/previous engineering experience within the Insurance industry would be highly regarded

Why choose AIA:

• At AIA, we’ve made a promise to help people live healthier, longer, better lives. And it starts with our own people
• AIA Australia is part of the larger regional Asia AIA Group, which is the largest public listed life insurance company in the Asia-Pacific region
• Access our training and development to build on your current skills
• Career development through internal mobility opportunities
• Work for a business helping millions of Australians and make a difference to someone’s life everyday
• Access additional leave days a year to recharge and refresh yourself
• Enjoy wonderful Health and Wellbeing initiatives that support you
• Work with supportive and inclusive working environment
• Flexible working arrangement
• At AIA Australia, we’re proud to help guide, support and protect the wellbeing of over 3.5 million Australians. Through life and health insurance, financial wellbeing and our total wellbeing ecosystem that includes AIA Vitality – the world’s leading science-backed wellbeing programme – we’ve started a movement to make Australia the healthiest, best protected nation in the world.
• As part of the AIA Group - the largest independent publicly listed pan-Asian life insurance group with a presence in 18 markets in Asia-Pacific – it is our ambition to engage one billion people to live Healthier, Longer, Better Lives by 2030. Lots of companies like to say they’re different. What makes us truly different at AIA, is the difference we make in people’s lives.

AIA is different. Are you?