Head of AI Data Evaluation & Training

Snorkel AI; New York (NY); On-site; USD 275,000 - 425,000; Full time

Job summary

Snorkel AI is seeking a manager to lead a team of researchers focused on data evaluation, error analysis, and data valuation methods to predict model performance. You and your team will demonstrate the value and quality of Snorkel’s data for model training and evaluation, identify where frontier models fall short, and define benchmarks and datasets to benefit customers.

Actual compensation will be determined based on skills and geographic location.

Qualifications

• 7+ years in applied AI, ML, or research roles with 4+ years managing technical teams.
• Proven ability to translate research into business outcomes and connect findings to market needs.
• Strong business and market judgment in AI/ML; understands frontier landscape.
• Technical credibility in LLM evaluation, benchmarking, and model behavior analysis.
• Ability to extract signals from evaluation results to guide roadmap.
• Excellent communication and storytelling to non-research audiences.
• Bonus: experience with frontier labs, public benchmarks, or commercial AI data/eval products.

Responsibilities

• Own a multi-quarter roadmap centered on novel evaluation, error analysis, and data valuation techniques.
• Synthesize trends from model-failure analysis into recommendations on datasets the community should focus on and investments for Snorkel.
• Focus on data valuation techniques that quantify how Snorkel data meaningfully improves model performance.
• Lead and grow a team of researchers, setting a high bar for quality, rigor and speed of execution.
• Act as the primary bridge between the team’s findings and Product, GTM, and customers.

Skills

Applied AI/ML

People management

Leadership

Communication

Strategic thinking

Data valuation

Job description

Snorkel AI is seeking a manager to lead a team of researchers focused on data evaluation, error analysis, and data valuation methods to predict model performance. You and your team will demonstrate the value and quality of Snorkel’s data for model training and evaluation, identify where frontier models fall short, and define benchmarks and datasets to benefit customers.

Actual compensation will be determined based on skills and geographic location.