Principal Data Scientist, AI & GenAI Model Validation

Commonwealth Bank; Sydney; On-site; AUD 180,000 - 240,000; Full time

Job summary

Commonwealth Bank is seeking a Principal Data Scientist to lead validation of ML and GenAI models at scale. You will shape validation practices, supervise governance, and collaborate with data science, engineering and governance stakeholders to ensure models are fit for purpose and risks are understood.

You will leverage PyTorch, AWS SageMaker and GenAI tooling, guiding multi-agent systems, RAG pipelines and orchestration with an emphasis on safe and accountable AI outcomes.

Qualifications

• Experience validating ML/AI models, incl. GenAI and transformer-based systems.
• Education in statistics, data science, CS or actuarial field or equivalent.
• Hands-on coding and model evaluation across pipelines and agents.

Responsibilities

• Lead independent review and validation of ML/AI models.
• Assess fit-for-purpose and risk controls of models, incl. GenAI and agents.
• Define and drive validation standards, tooling and governance.

Skills

ML/AI expertise

GenAI knowledge

Python

R

TypeScript

GitHub/CI/CD

Independent leadership

Communication

Education

Statistics/Data Science/CS/Actuarial or related

Tools

PyTorch

AWS SageMaker

LangChain

LangGraph

OpenAI Agents SDK

Pydantic

Langfuse/HoneyHive

Job description

Commonwealth Bank is seeking a Principal Data Scientist to lead validation of ML and GenAI models at scale. You will shape validation practices, supervise governance, and collaborate with data science, engineering and governance stakeholders to ensure models are fit for purpose and risks are understood.

You will leverage PyTorch, AWS SageMaker and GenAI tooling, guiding multi-agent systems, RAG pipelines and orchestration with an emphasis on safe and accountable AI outcomes.