Senior AI Model Validation Scientist

Commonwealth Bank of Australia; Sydney; On-site; AUD 140,000 - 190,000; Full time

Job summary

Commonwealth Bank of Australia in Sydney is seeking a Senior Data Scientist to independently review and validate AI use cases across the Group. You will assess risk, design proportional validation, and clearly explain findings to stakeholders.

Collaboration with developers, product owners and business teams is essential to ensure safe AI adoption. We value hands-on GenAI experience, strong Python skills, and the ability to build scalable evaluation pipelines while contributing to the team’s AI

Qualifications

• Hands-on experience designing, building and evaluating AI and Generative AI solutions.
• Experience with GenAI frameworks and tooling (LangChain, OpenAI Agents SDK, LangGraph).
• Strong Python, GitHub, and CI/CD skills for reliable validation workflows.
• Ability to communicate complex concepts to diverse audiences.

Responsibilities

• Independently review, challenge and validate AI use cases across the Group.
• Assess whether AI systems are fit for purpose and risks are understood and controlled.
• Design validation covering data, methodology, assumptions and outcomes.
• Explain findings clearly to technical and non-technical stakeholders.
• Help develop validation practices, tooling and standards for the team.
• Collaborate with model developers, product owners and business stakeholders.

Skills

GenAI knowledge

AI validation

Python programming

Communication skills

Independent critical thinking

Reproducible evaluation pipelines

Model risk assessment

Analytical mindset

Tools

LangChain

OpenAI Agents SDK

LangGraph

Pydantic

Langfuse / HoneyHive

Python

GitHub

CI/CD

SQL

R

TypeScript

Job description

Commonwealth Bank of Australia in Sydney is seeking a Senior Data Scientist to independently review and validate AI use cases across the Group. You will assess risk, design proportional validation, and clearly explain findings to stakeholders.

Collaboration with developers, product owners and business teams is essential to ensure safe AI adoption. We value hands-on GenAI experience, strong Python skills, and the ability to build scalable evaluation pipelines while contributing to the team’s AI