Expression of Interest: Principal Data Scientist – ML, Gen AI Model Validation

Commonwealth Bank; Sydney; On-site; AUD 180,000 - 240,000; Full time

Job summary

Commonwealth Bank is seeking a Principal Data Scientist to lead validation of ML and GenAI models at scale. You will shape validation practices, supervise governance, and collaborate with data science, engineering and governance stakeholders to ensure models are fit for purpose and risks are understood.

You will leverage PyTorch, AWS SageMaker and GenAI tooling, guiding multi-agent systems, RAG pipelines and orchestration with an emphasis on safe and accountable AI outcomes.

Qualifications

• Experience validating ML/AI models, incl. GenAI and transformer-based systems.
• Education in statistics, data science, CS or actuarial field or equivalent.
• Hands-on coding and model evaluation across pipelines and agents.

Responsibilities

• Lead independent review and validation of ML/AI models.
• Assess fit-for-purpose and risk controls of models, incl. GenAI and agents.
• Define and drive validation standards, tooling and governance.

Skills

ML/AI expertise

GenAI knowledge

Python

R

TypeScript

GitHub/CI/CD

Independent leadership

Communication

Education

Statistics/Data Science/CS/Actuarial or related

Tools

PyTorch

AWS SageMaker

LangChain

LangGraph

OpenAI Agents SDK

Pydantic

Langfuse/HoneyHive

Job description

Expression of Interest: Principal Data Scientist – ML, Gen AI Model Validation

• Scope and design validation of complex ML and Gen AI Models at scale
• Shape model validation in collaboration with Data Science, Engineering and Governance stakeholders
• Drive and lead best validation practices, tooling and standards, and streams of work

Do Work That Matters

AI & General Model Validation (AIGMV) provides independent technical challenge and review of the Group's most important ML and AI models, across business and support units.

At CommBank, we're investing in AI to create better customer experiences and meaningful value for the communities we serve.

We operate with a fintech mindset as we grow our global footprint and build our people's careers, including a diversified culture of international Tech Hubs established in Seattle and San Francisco, USA, working alongside unique partnerships with OpenAI, Anthropic, AWS and Microsoft to accelerate safer AI outcomes for Australia.

See yourself in our team

As a Principal Data Scientist within the team, you will lead independent review, challenge and validation of ML, statistical and AI models across the Group, including GenAI and agentic systems. You will assess whether they are fit for purpose and operate as intended, and whether the risks they introduce are understood and appropriately controlled.

We’re interested in hearing from people with:

• Technical foundation in ML/AI & statistics: Extensive experience developing, evaluating and validating ML/AI, GenAI or statistical models, traditional models (regression, random forests, XGBoost) and hands-on fine-tuning transformer models.
• Educational background: Degree in Statistics, Data Science, Computer Science, Actuarial Science or related field, or equivalent industry experience.
• Deep GenAI & agentic systems expertise: Working knowledge of GenAI and agentic architecture to validate and challenge orchestrators, sub-agents, RAG pipelines, tool use, guardrails, multi-agent routing, memory/persona handling and LLM-as-a-Judge backed by practical experience with PyTorch, AWS SageMaker and GenAI tooling such as LangChain, LangGraph, OpenAI Agents SDK, Pydantic and Langfuse/HoneyHive.
• Engineering & coding practice: Advanced hands-on coding in Python, R, TypeScript and use of AI coding agents - Claude Code, Codex, alongside GitHub, CI/CD, and skillfully read and navigate unfamiliar codebases, reproduce evaluation pipelines, write test harnesses and inspect trace data, and building/maintaining skills, sub-agents, hooks and plugins to automate workflows.
• Independent judgement & technical leadership: A courageous mindset with independent judgement, self-directed learning backed by curiosity and discipline to stay ahead of fast-changing AI techniques and risks, alongside technical leadership to lead projects, guide other data scientists through the work, turning complex systems into structured test plans.
• Communication across audiences: Strong communication skills to explain complex technical concepts clearly to mixed audiences, including senior stakeholders and governance forums.

Working with us

At CommBank, we foster a culture of inclusion and respect, celebrating diversity across cultures, abilities, capabilities, skills, global locations, genders, gender expressions and sexual orientations. We’re committed to making a meaningful difference for Australia’s First Nations peoples and welcome all applicants. We are open to international talent that would love to experience working in Australia.

Advertising End Date: 10/10/2026