Technical Lead - Data Engineering

AIA Australia; Melbourne; On-site; AUD 180,000 - 240,000; Full time

Benefits offered by this job

Training & development

Internal mobility

Health & wellbeing initiatives

Flexible working

Job summary

AIA Australia is executing a major technology, data and business transformation program. We are building a new modern platform on Azure Databricks and seeking a Technical Lead - Data Engineering to guide data migration from legacy systems and lead onshore/offshore engineers.

The role reports to the Head of Data Platforms and Analytics and can be based in Sydney or Melbourne. You will define detailed solutions, design scalable data frameworks, ensure data quality and security, and mentor a team

Qualifications

• Extensive hands-on data engineering and detailed design experience.
• Experience in insurance, banking or financial services is preferred.
• Proficiency with Python and SQL.
• Experience with Azure cloud services (ADF, ADLS, SQL).
• Ability to mentor and lead a team of engineers.

Responsibilities

• Define a detailed technical solution and manage delivery for the data engineering team.
• Design, build and maintain scalable data ingestion, curation and transformation using Azure Databricks.
• Oversee data modelling, ETL automation, DevOps, data quality and security.
• Collaborate with Business, Analytics, IT and vendors to align data work with priorities.
• Mentor and upskill engineers in Azure Databricks.

Skills

Data engineering

Azure Databricks

Python

SQL

Leadership

Mentoring

Tools

Azure Databricks

Azure Data Factory

Azure Data Lake Storage

Python

SQL

Job description

BE THE DIFFERENCE

At AIA we don’t simply believe in being ‘the best’. We believe in better – because there’s no limit to how far ‘better’ can take us. Everything we do is driven by our purpose to make a difference by helping people embrace Healthier, Longer, Better Lives. And every one of our people has an important part role to play. If you want to make a difference by helping shape a healthier, better-protected Australia, read on.

The Opportunity:

AIA Australia is currently undergoing a large technology, data and business transformation program resulting in refreshing the technology blueprint and the introduction of contemporary ways of working with the aim of creating a simpler, faster more connected organisation.

AIA is building a new modern platform using Azure Databricks. We are seeking a highly skilled and experienced Technical Lead - Data Engineering to join our Data Engineering team and lead data migration from legacy on-prem Data warehouse systems to Azure Databricks solutions.

This program of work will present both significant challenges and rewards, pushing your technical abilities and nurturing you to evolve into a data superhero. As a Technical Lead - Data Engineering, you will lead detailed technical design and do hands-on development along with overseeing development from onshore and offshore based data engineers to build robust, and scalable data products, aligned with our business objectives.

This role is reporting into the Head of Data Platforms and Analytics and can be based in either Sydney or Melbourne.

The successful candidate would be responsible for:

• Take full responsibility for defining a detailed technical solution and managing technical delivery of the data engineering team (onshore and offshore) based on detailed Business Requirements and aligned to the high level solution architecture data

• Design, Build and maintain scalable and efficient detailed design and frameworks using Azure Databricks for ingestion, curation and transformation of data

• Responsible for data modelling, ETL automation, DevOps, data quality, data security and performance optimization leveraging best practices of Azure cloud platform

• Work collaboratively with key stakeholders across Business, Analytics, IT teams (local and offshore) and vendors, ensuring alignment of data engineering efforts with business priorities

• Mentor and support a team of data engineers and analysts, in development of best engineering practice and upskilling engineers in Azure databricks toolset
  
  
  

To be successful in this position, you will have:

• Extensive previous data design related experience including hands-on Data engineering and detailed design, preferably in insurance, banking or financial services industry

• Demonstrated hands-on experience with developing and implementing data engineering and architecture frameworks and processes using Databricks, data modelling, and automation of ETL processes

• Demonstrated proficiency with the use of relevant programming languages, tools, and technologies such as Python and SQL

• Experience with Azure cloud platform and their data services like ADF, ADLS, SQL

• Strong problem-solving skills with the ability to analyze complex technical issues and propose effective solutions

• Excellent communication skills with the ability to convey technical concepts to both technical and non-technical stakeholders

• Strong leadership skills, including the ability to mentor, coach, and develop a high-performing data engineering team

• Certification in Databricks will be highly regarded

• Knowledge of/or previous engineering experience within the Insurance industry would be highly regarded
  
  

Why choose AIA:

• At AIA, we’ve made a promise to help people live healthier, longer, better lives. And it starts with our own people

• AIA Australia is part of the larger regional Asia AIA Group, which is the largest public listed life insurance company in the Asia-Pacific region

• Access our training and development to build on your current skills

• Career development through internal mobility opportunities

• Work for a business helping millions of Australians and make a difference to someone’s life everyday

• Access additional leave days a year to recharge and refresh yourself

• Enjoy wonderful Health and Wellbeing initiatives that support you

• Work with supportive and inclusive working environment

• Flexible working arrangement
  
  

At AIA Australia, we’re proud to help guide, support and protect the wellbeing of over 3.5 million Australians. Through life and health insurance, financial wellbeing and our total wellbeing ecosystem that includes AIA Vitality – the world’s leading science-backed wellbeing programme – we’ve started a movement to make Australia the healthiest, best protected nation in the world.

As part of the AIA Group - the largest independent publicly listed pan-Asian life insurance group with a presence in 18 markets in Asia-Pacific – it is our ambition to engage one billion people to live Healthier, Longer, Better Lives by 2030. Lots of companies like to say they’re different. What makes us truly different at AIA, is the difference we make in people’s lives.

AIA is different. Are you?

If you want to be part of an organisation that helps people live better every single day, apply via the link.