Senior Research Scientist - Frontier Data & Benchmarks

Snorkel AI; New York, San Francisco (NY, CA); Hybrid; USD 140,000 - 210,000; Full time

Job summary

Snorkel AI in New York, NY seeks a Staff or Senior Research Scientist to lead the development of frontier benchmarks and datasets. You will collaborate across research, data operations, product, and GTM to design, implement, and scale high-impact data solutions for real-world AI systems.

You’ll drive publications and customer engagements, translate research into commercially valuable insights, and mentor teams while reporting to the Head of Research in a fast-moving startup environment.

Qualifications

• Strong research background in AI/ML evaluation, NLP, or related fields.
• Exceptional communication skills to present findings clearly to technical and non-technical audiences.
• Experience driving rigorous experimental design and publication quality research.

Responsibilities

• Design state-of-the-art datasets for frontier model training and evaluation.
• Translate benchmark insights into compelling narratives for ROI and GTM materials.
• Collaborate cross-functionally with data ops, product, engineering, and strategy to surface findings.
• Stay at the frontier of LLM evaluation research and integrate best practices into Snorkel's workflows.
• Represent Snorkel's research externally through publications, talks, and customer engagements.

Skills

AI/ML evaluation

NLP

Research leadership

Experimental design

Education

Ph.D. in ML/NLP

Job description

Snorkel AI in New York, NY seeks a Staff or Senior Research Scientist to lead the development of frontier benchmarks and datasets. You will collaborate across research, data operations, product, and GTM to design, implement, and scale high-impact data solutions for real-world AI systems.

You’ll drive publications and customer engagements, translate research into commercially valuable insights, and mentor teams while reporting to the Head of Research in a fast-moving startup environment.