Data Engineer (AI Adoption)

Westpac Group; Sydney; On-site; AUD 140,000 - 190,000; Full time

Benefits offered by this job

Banking product discounts

Flexible work arrangements

Learning and development opportunities

Community volunteering

Job summary

Westpac Group is seeking a skilled Data Engineer to join Enterprise Platforms Engineering (EPE) and help shape how enterprise data is engineered, governed, and activated across customer, risk, and operational domains.

You will work with Hadoop, Python, PySpark, ETL, and Azure cloud technologies, delivering scalable data products and AI-enabled data platforms. Collaboration with product owners and security teams is key to success.

Qualifications

• Hands-on data engineering with cloud platforms and Azure stack.
• Strong experience in building scalable data pipelines and data products.
• Expert-level understanding of data modelling and warehousing concepts.
• Experience delivering AI/GenAI solutions in enterprise environments.

Responsibilities

• Design, build, and support cloud native, event driven data platforms and APIs.
• Develop and operate scalable data pipelines and storage solutions on Azure.
• Write high quality, secure, and maintainable code with strong performance and reliability.
• Optimize data pipelines, queries, and algorithms for scalability and cost efficiency.
• Produce and review technical designs, documentation, and runbooks.
• Engineer AI/GenAI ready datasets with data quality, lineage, and governance.
• Apply responsible AI, privacy, and data governance controls in regulated environments.
• Collaborate with delivery, product, architecture, security, and platform teams.
• Participate in code reviews, uplift engineering standards, and mentor others.
• Contribute to the strategic evolution of the data platform and engineering practices.

Skills

Hadoop

Python

PySpark

ETL

Azure cloud stack

Kafka

Java

Scala

Spring Boot

Azure Synapse

Cosmos DB

Git

Jenkins

CI/CD

Serverless architectures

Azure Data Lake

Azure Event Hubs

Snowflake

Teradata

Jira

Confluence

Data modelling

Data warehousing

GenAI

AI engineering

Prompting

RAG

Agents/tools

Tools

Jira

Confluence

Git

Job description

• Big Data and Azure Stack experience required

About the role:

We are seeking a skilled Data Engineer to join ourData Delivery line of business within Enterprise Platforms Engineering (EPE). You will be part of a team shaping how enterprise data is engineered, governed, and activated to deliver value across customer, risk, and operational domains.

First and foremost, we are looking for a Data Engineer with hands-on technical skills with Hadoop, Python, PySpark, ETL and the Azure cloud stack. You will combine strong technical depth with clear delivery ownership, working closely with product owners, service owners, and business stakeholders to translate complex requirements into scalable, reliable data products.

Additionally, you will help shape how agentic AI is adopted to improve engineering productivity and quality across the data lifecycle.This role will combine hands on data engineering with AI adoption strategies, to deliver scalable, secure, and resilient data solutions that create real business value.

About you:

You are passionate about cutting-edge technology and want to be part of a data engineering team that encourages innovation and supports growth and development. You bring strong technical expertise, and a product mindset, along with a genuine appetite to learn and grow.

Your key responsibilities include:

• Design, build, and support cloud native, event driven data platforms and APIs
• Develop and operate scalable data pipelines and storage solutions on Azure
• Build high quality, secure, and maintainable code with strong performance and reliability
• Optimise data pipelines, queries, and algorithms for scalability and cost efficiency
• Produce and review technical designs, documentation, and operational runbooks
• Engineer AI/ML ready datasets with strong data quality, lineage, and governance
• Apply responsible AI, privacy, and data governance controls in regulated environments
• Collaborate with delivery, product, architecture, security, and platform teams
• Participate in code reviews, uplift engineering standards, and mentor others
• Contribute to the strategic evolution of the data platform and engineering practices

What do I need?

• Experience with technologies such as Python, SQL, Kafka, Java, Scala, Spring Boot, Azure Synapse, Cosmos DB, and Git
• Hands-on experience with DevSecOps pipelines, particularly Jenkins and CI/CD practices
• Experience designing for cloud platforms, including serverless architectures, preferably on Azure
• Familiarity with Azure Synapse, Azure Data Lake Services, Azure Event Hubs, Azure Cosmos DB, Snowflake and Teradata platforms.
• A background in software engineering and experience with agile methodologies and tools such as Jira and Confluence
• Expert-level understanding of data modelling and data warehousing concepts
• Experience in AI engineering and GenAI delivery, including leading end-to-end delivery of AI/GenAI solutions—from discovery and design through deployment and production support.
• Able to build and operationalise GenAI using modern patterns (prompting, RAG, agents/tool use) with appropriate guardrails.
• Experience integrating AI capabilities into enterprise platforms and cloud environments, ensuring performance, resilience, security, and cost-effective scaling.

We’re obsessed with becoming our customers' #1 banking partner for life and we’re looking for people who are passionate about helping us achieve that goal.

In return, we’re committed to making Westpac the best place to work in the country. Here are just a few of the ways we’re already doing that:

• Special offers on banking products and discounts from top brands, including generous employee-only mortgage rates!
• Flexible work arrangements to help you achieve a greater work/life balance, and a variety of leave options including Culture, Lifestyle and Wellbeing leave.
• Tailored learning and development opportunities to help you grow your career within the bank.
• Lots of opportunities to ‘give back’ to the Community by getting involved in our many volunteering initiatives.

Create your future today!

We’re all about creating a supportive and inclusive community. We welcome everyone – no matter your age, gender, background, or abilities. We also provide additional support to welcome our veterans, Indigenous Australians and neurodiverse community.

If you need any adjustments during the recruitment process, you can find out more information and additional contact details by visiting the "People with Disability and/or needing Accessibility Requirements" page on our website.