Senior AI/ML Validation & Risk Specialist

Vanguard; Charlotte (NC); Hybrid; USD 140,000 - 190,000; Full time

Job summary

Vanguard Group is seeking an experienced model risk professional to independently validate and challenge AI/ML and generative AI models used across the enterprise. You will collaborate with data scientists, developers, and stakeholders to ensure models are sound, governed, and fit for purpose.

You will shape the model risk management framework, drive standards across the lifecycle, and mentor junior team members while navigating regulatory expectations and industry best practices.

Qualifications

• PhD in a quantitative discipline such as Computer Science, Mathematics, Statistics, Physics, Engineering.
• Minimum of 7 years of relevant experience in model development or model validation.
• Experience developing, testing or validating AI/ML models or systems using generative AI is required.
• Knowledge of programming languages including Python.
• Knowledge of technology platforms used for model development and deployment, CI/CD is a requirement.
• Knowledge of generative AI architectures including foundation models, RAG systems, agentic workflows, prompt engineering approaches, and associated risks such as hallucinations, algorithmic bias, and harmful outputs
• Knowledge of AI/ML modeling including ML algorithms, NLP, deep learning, and evaluation methodologies
• Exceptional written communication skills, including the ability to communicate complex model risks to audiences ranging from technical practitioners to senior executives
• Experience in the financial services sector is a plus
• Broad knowledge of risk management at financial institutions preferred
• Ability to deal effectively with a variety of stakeholder teams
• Ability to effectively manage multiple and competing priorities
• Exhibits flexibility and excellent judgment

Responsibilities

• Lead independent validation and challenge of AI models across the enterprise, including ongoing monitoring and remediations.
• Provide effective challenge of model assumptions, methodologies, data, testing, and limitations with focus on material risk drivers.
• Assess compliance with internal AI standards, regulatory requirements, and governance expectations for AI/ML systems.
• Ensure timely execution of model validation and high-quality validation reports for technical and non-technical stakeholders.
• Develop and enhance validation procedures for a risk-based approach across the model lifecycle.
• Contribute to design and update of model risk management policies, standards, and procedures.
• Advise stakeholders on Model Risk policy and related standards as needed.
• Identify emerging risks across AI/ML and generative AI models and surface to MRM leadership.
• Provide coaching and mentorship to junior team members.
• Participate in special projects and perform other duties as assigned.

Skills

Generative AI knowledge

NLP and Deep Learning

AI risk assessment

Executive communication

Stakeholder management

Project management

Education

PhD in a quantitative discipline

Tools

Python

CI/CD tools

Model development platforms

Job description

Vanguard Group is seeking an experienced model risk professional to independently validate and challenge AI/ML and generative AI models used across the enterprise. You will collaborate with data scientists, developers, and stakeholders to ensure models are sound, governed, and fit for purpose.

You will shape the model risk management framework, drive standards across the lifecycle, and mentor junior team members while navigating regulatory expectations and industry best practices.