Advanced Analytics Senior Analyst / Applied AI Specialist

Commonwealth Bank; Sydney; On-site; AUD 150,000 - 190,000; Full time

Job summary

Commonwealth Bank in Sydney seeks a Senior Advanced Analytics Analyst / Applied AI Specialist to design, build and scale AI-enabled QA automation across fraud operations. You’ll work with customer interaction data, call transcripts and case notes to classify fraud and improve assurance and outcomes.

You’ll use LLMs, classification models, SQL and Python, plus multi‑agent orchestration to automate parts of QA, test reliability and translate AI outputs into practical recommendations for risk,

Qualifications

• Experience in data science, applied AI or ML engineering with practical exposure to LLMs and AI-enabled automation.
• Proficiency in SQL and Python for data extraction and analysis, including unstructured text.
• Experience applying NLP and conversation analytics to classify or extract insights from text.

Responsibilities

• Design, build and scale AI-enabled QA automation across fraud operations.
• Use customer data, transcripts and case notes to classify fraud and improve assurance.
• Translate model outputs into actionable recommendations for risk, operations and tech stakeholders.

Skills

Data science

Applied AI

LLMs

Prompt engineering

Classification models

SQL

Python

AI workflow automation

Multi-agent orchestration

Stakeholder communication

Tools

Copilot Studio

Orchestration frameworks

Job description

• Partner with world-class technology, data and AI specialists
• Transform quality assurance through intelligent automation

• Build with cutting-edge AI technology
• Partner with world-class technology, data and AI specialists
• Transform quality assurance through intelligent automation

See Yourself in the Team

Group Fraud Management Services plays a critical role in protecting our customers, our people and the Group from the evolving threat of financial crime. The team brings together fraud operations, intelligence, analytics and assurance capabilities to help the business understand emerging risks, respond with confidence and make better risk-based decisions.

You’ll join a high-impact environment where data, advanced analytics and emerging technologies are used to strengthen quality assurance across complex customer and operational settings.

Your Impact & Contribution

As a Senior Advanced Analytics Analyst / Applied AI Specialist, you’ll help design, build and scale AI-enabled QA automation across fraud and scam operations. You’ll work with customer interaction data, call transcripts, case management data and operational datasets to classify fraud and scam scenarios, assess conversation quality, evaluate process adherence and generate insights that improve assurance, consistency and customer outcomes.

In this role, you will use LLMs, classification models, SQL, Python and multi-agent orchestration workflows to automate parts of the quality assurance process. You’ll also support testing and evaluation, improve model reliability, reduce hallucinations and translate AI outputs into clear, defensible recommendations for operational, risk and technology stakeholders.

This is an opportunity to work at the intersection of applied AI, data science, automation and customer outcomes, helping shape how intelligent automation strengthens quality assurance in a complex operational environment. You’ll help generate meaningful insights, improve consistency and support scalable assurance practices that contribute to better operational and customer outcomes.

Your Skills & Experience

• You’ll bring strong experience in data science, applied AI or machine learning engineering, with practical exposure to LLMs, prompt engineering, classification models and AI-enabled automation.
• You’ll be confident using SQL and Python to extract, prepare and analyse complex datasets, and comfortable working with unstructured text such as call transcripts, messages or case notes.
• You’ll bring experience applying NLP, conversation analytics or LLMs to classify, assess or extract insight from unstructured text.
• Experience with AI workflow automation, multi-agent orchestration, Copilot Studio or similar orchestration frameworks would be highly valuable.
• You’ll be comfortable working in modern development environments that support version control, collaboration and AI-assisted development.
• You’ll also bring strong stakeholder skills, with the ability to understand business problems, explain technical concepts clearly and turn model outputs into practical insights and recommendations.
• Experience in fraud, scams, financial crime, quality assurance, risk, compliance or controls testing would be beneficial, but the priority is strong applied AI capability and the ability to build solutions that are reliable, measurable and fit for purpose.

What’s In It For You?

Work in a culture of innovation where emerging AI capability is being applied to meaningful, real-world challenges across fraud and scam operations. You’ll gain access to cutting-edge AI technology, partner with world-class engineers, data scientists and technology specialists, and help shape how LLMs, classification models and multi-agent orchestration are used to improve quality assurance at scale.

This is a rare opportunity to work on high-impact applied AI in a complex banking environment, with the space to experiment, build, test and scale solutions that improve customer outcomes, operational consistency and assurance effectiveness.

Working With Us

At CommBank, we're committed to creating an accessible, inclusive and respectful workplace. If you require support or adjustments, please let us know.

We welcome applications from people of all backgrounds and we're particularly committed to making a positive difference for Aboriginal and/or Torres Strait Islander Peoples. For support, please contact 1800 989 696.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.

Advertising End Date: 17/09/2026