Senior AI Validation Scientist: Risk, Quality & Impact

Commonwealth Bank; Sydney; On-site; AUD 120,000 - 170,000; Full time

Job summary

Commonwealth Bank is seeking a Senior Data Scientist in AI & General Model Validation to independently review, challenge and validate AI use cases across the Group. You will design validation across data, methodology, and outcomes and explain findings to technical and non-technical stakeholders.

Collaborate with model developers and business stakeholders while remaining independent, help develop validation practices, tooling and standards, and contribute to safe, scalable AI adoption.

Qualifications

• Independent validation of AI use cases across complex banking AI deployments.
• Ability to design thorough validation covering data, methodology, assumptions and outcomes.
• Strong communication of findings to both technical and non-technical stakeholders.

Responsibilities

• Review and challenge AI/ML models to ensure fit for purpose and risk controls.
• Design validation pipelines and frameworks for ongoing AI deployments.
• Collaborate with model developers, product owners and business stakeholders while maintaining independence.
• Contribute to the development of validation practices, tooling and standards across the team.

Skills

AI validation

Self-directed learning

Attention to detail

GenAI knowledge

AI frameworks/tools

Python

GitHub/CI/CD

Communication

Traditional ML models

Problem solving

Tools

LangChain

OpenAI Agents SDK

LangGraph

Pydantic

Langfuse/HoneyHive

Job description

Commonwealth Bank is seeking a Senior Data Scientist in AI & General Model Validation to independently review, challenge and validate AI use cases across the Group. You will design validation across data, methodology, and outcomes and explain findings to technical and non-technical stakeholders.

Collaborate with model developers and business stakeholders while remaining independent, help develop validation practices, tooling and standards, and contribute to safe, scalable AI adoption.