Research Scientist — Frontier Data Benchmarks & AI Evaluation

Snorkel AI; United States; On-site; USD 200,000 - 350,000; Full time

Job summary

Snorkel AI seeks a Research Scientist to collaborate with partners and lead the development of benchmarks and datasets for frontier models. This highly visible, customer‑facing role sits at the intersection of research, strategy, and go‑to‑market. You will design datasets and work with academic partners, then scale production with delivery, product and GTM.

You will serve as a credible technical partner for customers and drive results that advance the broader research community.

Qualifications

• Strong research background in AI/ML evaluation, NLP, or related fields, with a track record of rigorous experimental design — especially around measuring the impact of training and evaluation data on model behaviour.
• Exceptional communication skills — able to present complex technical findings clearly to both technical and non‑technical audiences
• Comfort operating in a fast‑moving, cross‑functional environment with ambiguous problem spaces
• Genuine interest in GTM strategy, startup dynamics, and the commercial side of AI data services.
• Ph.D. in machine learning, NLP, or a related field preferred; equivalent industry or research lab experience considered.

Responsibilities

• Design state of the art datasets that drive frontier model training and evaluation based on current model performance and academic partnerships
• Translate benchmark insights into clear, compelling narratives that articulate the ROI of expert‑curated data for customer‑facing presentations, technical reports, and go‑to‑market materials.
• Work cross‑functionally with data operations, product, engineering, and strategy to surface research findings that inform the company roadmap.
• Stay at the frontier of LLM evaluation research and bring best practices into Snorkel's workflows
• Represent Snorkel's research externally through publications, blog posts, conference talks, and customer engagements that advance the conversation around data‑centric AI

Skills

AI/ML evaluation

NLP

Communication

Cross-functional

Experiment design

Education

PhD in ML/NLP

Job description

Snorkel AI seeks a Research Scientist to collaborate with partners and lead the development of benchmarks and datasets for frontier models. This highly visible, customer‑facing role sits at the intersection of research, strategy, and go‑to‑market. You will design datasets and work with academic partners, then scale production with delivery, product and GTM.

You will serve as a credible technical partner for customers and drive results that advance the broader research community.