Senior AI Automation Analyst for Fraud QA

eFinancialCareers Ltd.; Sydney; Sur place; AUD 140 000 - 190 000; Plein temps

Résumé du poste

Commonwealth Bank is seeking a Senior Analyst, Applied AI & Automation to design agentic AI solutions that transform fraud and scams QA. You’ll work with Fraud Analytics, QA, Product and Technology teams to build measurable automation using SQL, Python, LLMs and orchestration frameworks.

This foundational role shapes how the capability evolves, bringing ideas to life with strong governance, reliability and human oversight across technical and operational stakeholders.

Qualifications

• Strong hands-on analytics capability with SQL and Python to extract, prepare, analyse and interpret complex data.
• Experience applying classification, predictive analytics, ML or statistical modelling to real-world problems.
• Experience designing solutions using Generative AI and LLMs, not just using AI tools.
• Experience developing agentic or multi-step AI workflows including orchestration and tool use.
• Experience applying NLP or conversation analytics to extract insights from unstructured text.
• Understanding AI evaluation, testing model/agent behaviour and reducing hallucinations.
• Familiarity with agentic/orchestration frameworks (Copilot Studio, LangGraph, LangChain, Semantic Kernel, AutoGen).
• Strong development practices (Git, APIs) and collaborative AI-assisted environments.
• Curiosity to prototype ideas rapidly and translate analytics into measurable outcomes.

Responsabilités

• Design and build agentic AI solutions that automate and enhance the Fraud and Scams QA lifecycle.
• Explore how LLMs and intelligent automation can replace or augment manual QA processes.
• Develop multi-step AI workflows that reason across data and interact with tools.
• Use SQL and Python to analyse complex customer, interaction and operational data.
• Apply NLP and ML to support evaluation and classification tasks.
• Prototype, evaluate and improve AI approaches, focusing on reliability.
• Design testing and evaluation frameworks to measure performance and reduce failure modes.
• Collaborate with Fraud Analytics, QA, Product, Technology and Risk teams to drive implementation.

Connaissances

SQL

Python

NLP

LLMs

Agentic AI

AI workflows

Outils

Copilot Studio

LangGraph

LangChain

Semantic Kernel

AutoGen

Description du poste

Commonwealth Bank is seeking a Senior Analyst, Applied AI & Automation to design agentic AI solutions that transform fraud and scams QA. You’ll work with Fraud Analytics, QA, Product and Technology teams to build measurable automation using SQL, Python, LLMs and orchestration frameworks.

This foundational role shapes how the capability evolves, bringing ideas to life with strong governance, reliability and human oversight across technical and operational stakeholders.