Lead AI Validation Scientist: Independent Model Review

Commonwealth Bank; Sydney; Presencial; AUD 140.000 - 200.000; Jornada completa

Descripción de la vacante

Commonwealth Bank in Sydney is seeking a Senior Data Scientist to independently review, challenge and validate AI use cases across the Group, ensuring AI systems are fit for purpose and operate as intended.

You will design validation across data, methodology, assumptions and outcomes, communicate findings to technical and non-technical audiences, and help advance the team’s AI validation practices and tooling.

Formación

• Hands-on experience designing, building and evaluating AI and Generative AI solutions.
• Experience with GenAI frameworks and tooling is required.
• Ability to read unfamiliar codebases and reproduce evaluation pipelines.

Responsabilidades

• Independently review, challenge and validate AI use cases across the Group.
• Assess AI systems for fitness, risk and control, and explain findings to stakeholders.
• Develop validation practices, tooling and standards for the team.

Conocimientos

Advanced Python

Strong communication

Self-directed learning

Attention to detail

Stakeholder collaboration

Herramientas

LangChain

OpenAI API

LangGraph

Pydantic

Langfuse/HoneyHive

Python

SQL

Descripción del empleo

Commonwealth Bank in Sydney is seeking a Senior Data Scientist to independently review, challenge and validate AI use cases across the Group, ensuring AI systems are fit for purpose and operate as intended.

You will design validation across data, methodology, assumptions and outcomes, communicate findings to technical and non-technical audiences, and help advance the team’s AI validation practices and tooling.