Senior AI Validation & Model Risk Lead

The Vanguard Group; Lees (PA); Hybrid; USD 140,000 - 200,000; Full time

Benefits offered by this job

Visa sponsorship

Job summary

The Vanguard Group is seeking an experienced model risk professional to lead independent validation and challenge of AI/ML and generative AI models across the enterprise. You will work with data scientists, developers, model users and technology partners to ensure models are sound, well-governed and fit for purpose.

You will help shape Vanguard’s model risk framework, advancing methodologies, standards, and practices for enterprise-wide application of model risk principles while collaborating

Qualifications

• PhD in a quantitative discipline such as Computer Science, Mathematics, Statistics, Physics, Engineering or equivalent.
• Minimum of 7 years of relevant experience in model development or model validation.
• Experience developing, testing or validating AI/ML models or systems using generative AI is required.
• Knowledge of programming languages including Python is a requirement.
• Knowledge of technology platforms used for model development and deployment, CI/CD is a requirement.
• Knowledge of generative AI architectures including foundation models, RAG systems, agentic workflows, prompt engineering approaches, and associated risks such as hallucinations, algorithmic bias, and harmful outputs.
• Knowledge of AI/ML modeling including ML algorithms, NLP, deep learning, and evaluation methodologies.
• Exceptional written communication skills are required, including the ability to communicate complex model risks to audiences ranging from technical practitioners to senior executives.
• Experience in the financial services sector is a plus.
• Broad knowledge of risk management at financial institutions preferred.
• Ability to deal effectively with a variety of stakeholder teams.
• Ability to effectively manage multiple and competing priorities.
• Exhibits flexibility and excellent judgment.

Responsibilities

• Assess models and systems using generative AI throughout their lifecycle including leading independent validations and assessment of ongoing monitoring, change management, and remediations of model risk findings
• Provide effective challenge of model assumptions, methodologies, data, testing, implementation, monitoring and limitations, with a focus on material risk drivers
• Assess compliance with internal AI standards, emerging regulatory requirements, and governance expectations related to AI/ML and generative AI systems, including fairness, explainability, transparency, and human oversight
• Ensure timely execution of model validation and high-quality validation reports that meet internal standards, and communicate validation findings clearly to technical and non‑technical stakeholders
• Develop, maintain and enhance validation procedures to support a consistent, risk‑based approach for independent validation and effective challenge of AI/ML and generative AI systems, including keeping informed of the evolution of technology in generative and agentic AI
• Contribute to the design and enhancement of model risk management policies, standards, and procedures across the full model lifecycle (inventory, development, validation, approval, and ongoing monitoring)
• Support the MRM team in advising stakeholders on Model Risk policy and other relevant standards as needed
• Identify emerging and top risks across the portfolio of AI/ML and generative AI models and surface them to MRM leadership
• Provide coaching and mentorship to junior team members
• Participate in special projects and perform other duties as assigned

Skills

Independent validation

Stakeholder management

Multitasking

Clear communication

Judgment

Education

PhD in a quantitative discipline

Tools

Python

CI/CD

NLP

Deep Learning

Generative AI

Job description

The Vanguard Group is seeking an experienced model risk professional to lead independent validation and challenge of AI/ML and generative AI models across the enterprise. You will work with data scientists, developers, model users and technology partners to ensure models are sound, well-governed and fit for purpose.

You will help shape Vanguard’s model risk framework, advancing methodologies, standards, and practices for enterprise-wide application of model risk principles while collaborating