AI Risk & Model Validation Scientist

Macquarie Group; Sydney; Hybrid; AUD 120,000 - 190,000; Full time

Benefits offered by this job

Wellbeing leave

Parental leave up to 20 weeks

Volunteer leave & donation matching

Gender affirmation leave

EAP & wellbeing benefits

Salary packaging options

Learning & development benefits

Hybrid work arrangements

WFH equipment reimbursement

Job summary

Macquarie Group is seeking a Data Scientist within Model Risk Management to review and validate artificial intelligence use cases across the firm. You will ensure AI systems are fit-for-purpose, operate as intended and are kept within risk appetite.

You will design validation approaches, assess data and methodologies, and clearly communicate findings to both technical and non-technical stakeholders. You will collaborate with model developers, product owners, and business stakeholders to provide

Qualifications

• Hands-on experience designing, developing, and evaluating AI and Generative AI solutions including RAG and LLM evaluation frameworks.
• Experience with modern GenAI frameworks and tooling.
• Advanced Python programming and CI/CD pipelines.

Responsibilities

• Review, challenge and validate AI use cases across the firm.
• Assess AI systems for fit-for-purpose and risk alignment.
• Design and execute validation approaches, assess data, methodology and outcomes.
• Clearly articulate findings to technical and non-technical stakeholders.

Skills

Python

AI/GenAI

LangChain

LangGraph

OpenAI Agents SDK

Langfuse

DeepEval

RAG

LLM evaluation

GitHub

CI/CD

SQL

R

TypeScript

Tools

LangChain

LangGraph

Google ADK

OpenAI Agents SDK

Langfuse

DeepEval

Claude Code

Codex

Job description

Macquarie Group is seeking a Data Scientist within Model Risk Management to review and validate artificial intelligence use cases across the firm. You will ensure AI systems are fit-for-purpose, operate as intended and are kept within risk appetite.

You will design validation approaches, assess data and methodologies, and clearly communicate findings to both technical and non-technical stakeholders. You will collaborate with model developers, product owners, and business stakeholders to provide