VP, AI Validation & Governance — Enterprise Risk

Burtch Works; New York (NY); Hybrid; USD 220,000 - 340,000; Full time

Job summary

Burtch Works in New York, NY is seeking a Corporate Vice President – Model Validation and AI Governance to lead validation across predictive, generative, and agentic AI solutions, partnering with Model Risk Management and Legal, Compliance, Cybersecurity, and other teams.

The role will challenge methodologies, establish robust evaluation approaches, set standards, and drive observability, dashboards, and governance practices while mentoring junior staff.

Qualifications

• Advanced degree in a quantitative field (stats, CS, data science, math, econ, eng).
• 7+ years of experience in model validation, governance, or risk management for AI/ML in regulated environments.
• Hands-on experience validating generative and agentic AI systems, including multi-step workflows and guardrails.
• Experience designing AI evaluation frameworks and testing (datasets, rubrics, adversarial testing).
• Proficiency in Python and SQL with AI tooling exposure.
• Strong communication and leadership to present findings to senior leadership.

Responsibilities

• Lead independent validation across predictive, ML, generative, and agentic AI.
• Evaluate architecture, planning, tool use, memory, and guardrails for agentic systems.
• Develop evaluation frameworks, datasets, scoring, and testing.
• Establish monitoring and third-party validation approaches.
• Evaluate vendor and foundation models with evidence and controls.
• Translate regulatory requirements into validation methodologies and SOPs.
• Present findings to senior stakeholders and governance committees.
• Create reusable templates and best practices across teams.

Skills

Statistical methods

ML validation

Python

SQL

Communication

Leadership

Education

Advanced degree in a quantitative field

Tools

Python

SQL

Job description

Burtch Works in New York, NY is seeking a Corporate Vice President – Model Validation and AI Governance to lead validation across predictive, generative, and agentic AI solutions, partnering with Model Risk Management and Legal, Compliance, Cybersecurity, and other teams.

The role will challenge methodologies, establish robust evaluation approaches, set standards, and drive observability, dashboards, and governance practices while mentoring junior staff.