Head of Research: Data Evaluation & Training

Snorkel AI; New York (NY); On-site; USD 275,000 - 425,000; Full time

Job summary

Snorkel AI is seeking a data-evaluation leader to guide a team focused on evaluation, error analysis, and data valuation methods for frontier AI applications. You will translate research insights into actionable datasets and benchmarks to influence product direction and customer impact.

You will build and mentor a team of researchers, shaping multi-quarter roadmaps and aligning findings with product, GTM, and client needs, while maintaining high standards of rigor and speed.

Qualifications

• 7+ years in applied AI, ML, or research roles.
• 4+ years managing technical teams.
• Ability to translate research into business outcomes.
• Strong market judgment in AI/ML space.
• Familiar with LLM evaluation and benchmarking.
• Excellent storytelling to non-research audiences.
• Bonus: experience with frontier labs or public benchmarks.

Responsibilities

• Own a multi-quarter roadmap centered on evaluation, error analysis, and data valuation.
• Synthesize trends from model failures into dataset recommendations.
• Lead data valuation work to quantify data impact on performance.
• Grow a research team, uphold quality and speed.
• Bridge findings to Product, GTM, and customers.

Skills

Applied AI

ML leadership

Team management

Data evaluation

Benchmarking

Model evaluation

Data valuation

Strategic thinking

Communication skills

Job description

Snorkel AI is seeking a data-evaluation leader to guide a team focused on evaluation, error analysis, and data valuation methods for frontier AI applications. You will translate research insights into actionable datasets and benchmarks to influence product direction and customer impact.

You will build and mentor a team of researchers, shaping multi-quarter roadmaps and aligning findings with product, GTM, and client needs, while maintaining high standards of rigor and speed.