Head of Data Evaluation & AI Performance

Snorkel AI; San Francisco (CA); On-site; USD 275,000 - 425,000; Full time

Job summary

Snorkel AI is seeking a senior leader to guide a team of researchers focused on data evaluation, error analysis, and data valuation to predict model performance. You’ll shape the data design flywheel, analyze failures, and identify benchmarks and datasets to drive customer value.

You will lead a multi-quarter roadmap, translate insights into strategic data investments, and collaborate with Product, GTM, and customers to demonstrate measurable impact on model quality and business outcomes.

Qualifications

• 7+ years in applied AI, ML, or research roles, with 4+ years managing technical teams.
• Proven ability to translate research and analysis into business outcomes.
• Strong business and market judgment in the AI/ML space.
• Technically credible in LLM evaluation, benchmarking, and model behavior analysis.
• Excellent communication and storytelling so technical results are persuasive to non-research audiences.
• Bonus: experience with frontier labs, public benchmarks, or AI data/eval products.

Responsibilities

• Own a multi-quarter roadmap centered on novel evaluation, error analysis, and data valuation techniques.
• Synthesize trends from model-failure analysis and benchmarking into dataset recommendations.
• Focus on data valuation techniques that quantify how Snorkel data improves model performance.
• Lead and grow a team of researchers with high standards for quality and speed.
• Bridge findings to Product, GTM, and customer teams.

Skills

AI leadership

Team management

Data valuation

Benchmarking

Communication

Strategic thinking

Market awareness

Job description

Snorkel AI is seeking a senior leader to guide a team of researchers focused on data evaluation, error analysis, and data valuation to predict model performance. You’ll shape the data design flywheel, analyze failures, and identify benchmarks and datasets to drive customer value.

You will lead a multi-quarter roadmap, translate insights into strategic data investments, and collaborate with Product, GTM, and customers to demonstrate measurable impact on model quality and business outcomes.