Applied AI & QA Automation Senior Analyst

Commonwealth Bank; Sydney; On-site; AUD 150,000 - 190,000; Full time

Job summary

Commonwealth Bank in Sydney seeks a Senior Advanced Analytics Analyst / Applied AI Specialist to design, build and scale AI-enabled QA automation across fraud operations. You’ll work with customer interaction data, call transcripts and case notes to classify fraud and improve assurance and outcomes.

You’ll use LLMs, classification models, SQL and Python, plus multi‑agent orchestration to automate parts of QA, test reliability and translate AI outputs into practical recommendations for risk,

Qualifications

• Experience in data science, applied AI or ML engineering with practical exposure to LLMs and AI-enabled automation.
• Proficiency in SQL and Python for data extraction and analysis, including unstructured text.
• Experience applying NLP and conversation analytics to classify or extract insights from text.

Responsibilities

• Design, build and scale AI-enabled QA automation across fraud operations.
• Use customer data, transcripts and case notes to classify fraud and improve assurance.
• Translate model outputs into actionable recommendations for risk, operations and tech stakeholders.

Skills

Data science

Applied AI

LLMs

Prompt engineering

Classification models

SQL

Python

AI workflow automation

Multi-agent orchestration

Stakeholder communication

Tools

Copilot Studio

Orchestration frameworks

Job description

Commonwealth Bank in Sydney seeks a Senior Advanced Analytics Analyst / Applied AI Specialist to design, build and scale AI-enabled QA automation across fraud operations. You’ll work with customer interaction data, call transcripts and case notes to classify fraud and improve assurance and outcomes.

You’ll use LLMs, classification models, SQL and Python, plus multi‑agent orchestration to automate parts of QA, test reliability and translate AI outputs into practical recommendations for risk,