Frontier AI Research Scientist — Data & Benchmark Innovator

JRNLClub; San Francisco (CA); Hybrid; USD 150,000 - 190,000; Full time

Job summary

Snorkel AI is seeking a Research Scientist to design frontier benchmarks and datasets, collaborating with partners to shape model evaluation. You will interact across research, data operations, product, and go-to-market to scale production and communicate value to customers and partners.

You will help publish results, present at conferences, and engage with customers, contributing to the broader research community while aligning with company strategy and growth goals.

Qualifications

• Strong research background in AI/ML evaluation, NLP, or related fields with a track record of rigorous experimental design.

Responsibilities

• Design state of the art datasets that drive frontier model training and evaluation based on current model performance and academic partnerships.
• Translate benchmark insights into clear, compelling narratives that articulate the ROI of expert-curated data for customer-facing presentations, technical reports, and go-to-market materials.
• Work cross-functionally with data operations, product, engineering, and strategy to surface research findings that inform the company roadmap.
• Stay at the frontier of LLM evaluation research and bring best practices into Snorkel's workflows.
• Represent Snorkel's research externally through publications, blog posts, conference talks, and customer engagements that advance the conversation around data-centric AI.

Skills

AI/ML evaluation

NLP

Experimental design

Communication skills

Education

PhD in machine learning or NLP

Tools

Python

TensorFlow

JAX

Job description

Snorkel AI is seeking a Research Scientist to design frontier benchmarks and datasets, collaborating with partners to shape model evaluation. You will interact across research, data operations, product, and go-to-market to scale production and communicate value to customers and partners.

You will help publish results, present at conferences, and engage with customers, contributing to the broader research community while aligning with company strategy and growth goals.