AI Evaluations Team Lead

FNZ (UK) Ltd; Gurugram District; On-site; INR 1,500,000 - 3,000,000; Full time

Job summary

FNZ (UK) Ltd in Gurugram, India seeks a Senior AI Evaluations Team Lead to steer the design and implementation of FNZ's AI evaluations framework across technical and process dimensions, ensuring safety, performance, and regulatory alignment before production.

The role combines hands-on leadership with governance, mentoring a team of evaluation specialists, building evaluation toolchains, and driving adoption of standards across multiple AI product teams while communicating findings to

Qualifications

• 7+ years of engineering experience, with 3+ years in AI/ML or security testing and 2+ years in evaluation/red teaming.
• Deep understanding of LLM-based agents, RAG architectures, and agentic AI systems (not model training).
• Strong programming background with hands-on experience building evaluation tooling, harnesses, or automated assessment workflows for AI agents and solutions.
• Experience embedding evaluation, assurance, or control frameworks into software delivery lifecycles and release governance, ideally within regulated environments.

Responsibilities

• Lead the team that defines, builds, and evolves FNZ's AI evaluations framework across technical components and operating processes.
• Establish evaluation standards, methodologies, tooling, and governance processes; embed into FNZ's SDLC as release gates.
• Represent evaluations function in AI Governance Committee with risk assessments and release recommendations.
• Mentor and lead evaluation specialists to implement the framework across multiple AI product teams.
• Design and execute complex evaluations for high-risk AI agents; lead red-teaming exercises for critical deployments.
• Communicate evaluation findings to technical and non-technical stakeholders; influence product roadmaps.

Skills

AI/ML experience

Security testing

Evaluation / red teaming

LLM-based agents

RAG architectures

Agentic AI systems

Programming

Evaluation tooling

Release governance

Leadership

Python

Automation workflows

Evaluation harnesses

Tools

Python

Automation workflows

Evaluation harnesses

Job description

AI Evaluations Team Lead

Location: Gurugram, India Seniority: Senior (7+ years engineering experience)

Purpose: Lead the team responsible for building FNZ's AI evaluations framework across both technical and process dimensions, and drive implementation of that framework across AI solutions to ensure rigorous safety, performance, and compliance standards before production deployment.

Key Responsibilities

• Lead the team that defines, builds, and evolves FNZ's AI evaluations framework across both technical components and operating processes, aligned to FNZ's six-pillar framework (Task Performance, Safety & Compliance, Efficiency, Groundedness & Reasoning, Robustness, Suitability)
• Establish evaluation standards, methodologies, tooling, and governance processes, and lead implementation of the framework across AI solutions by embedding it into FNZ's SDLC as mandatory release gates
• Represent evaluations function in AI Governance Committee, providing risk assessments and release recommendations
• Build, mentor, and lead a team of evaluation specialists responsible for developing the framework and partnering with AI solution teams to implement it consistently across the estate
• Design and execute complex evaluations for high-risk AI agents; lead red teaming exercises for critical deployments
• Communicate evaluation findings to technical and non-technical stakeholders; influence product roadmaps

Skills and Experience

• 7+ years of engineering experience, with 3+ years in AI/ML or security testing and 2+ years in evaluation/red teaming
• Deep understanding of LLM-based agents, RAG architectures, and agentic AI systems (not model training)
• Strong programming background with hands-on experience building evaluation tooling, harnesses, or automated assessment workflows for AI agents and solutions
• Proven ability to design evaluation methodologies and frameworks for probabilistic AI systems, covering both technical measures and operational processes
• Experience embedding evaluation, assurance, or control frameworks into software delivery lifecycles and release governance, ideally within regulated environments
• Leadership experience building or managing cross-functional teams and driving adoption of standards across multiple AI products or solution teams
• Ability to translate safety, risk, and compliance requirements into practical evaluation criteria, controls, and release recommendations for production AI solutions

About FNZ

About FNZ FNZ is committed to opening up wealth so that everyone, everywhere can invest in their future on their terms. We know the foundation to do that already exists in the wealth management industry, but complexity holds firms back. We created wealth's growth platform to help. We provide a global, end-to-end wealth management platform that integrates modern technology with business and investment operations. All in a regulated financial institution. We partner with the world's leading financial institutions, with over US$2.5 trillion in assets on platform (AoP). Together with our clients, we empower nearly 30 million people across all wealth segments to invest in their future. FNZ is committed to opening up wealth so that everyone, everywhere can invest in their future on their terms. We know the foundation to do that already exists in the wealth management industry, but complexity holds firms back. We created wealth's growth platform to help. We provide a global, end-to-end wealth management platform that integrates modern technology with business and investment operations. All in a regulated financial institution. We partner with the world's leading financial institutions, with over US$2.5 trillion in assets on platform (AoP). Together with our clients, we empower nearly 30 million people across all wealth segments to invest in their future.

FNZ is committed to opening up wealth so that everyone, everywhere can invest in their future on their terms. We know the foundation to do that already exists in the wealth management industry, but complexity holds firms back. We created wealth's growth platform to help. We provide a global, end-to-end wealth management platform that integrates modern technology with business and investment operations. All in a regulated financial institution. We partner with the world's leading financial institutions, with over US$2.5 trillion in assets on platform (AoP). Together with our clients, we empower nearly 30 million people across all wealth segments to invest in their future.