Senior Research Scientist: Frontier AI Benchmarks & Datasets

AItoolnavio; New York, San Francisco (NY, CA); Hybrid; USD 180,000 - 260,000; Full time

Job summary

Snorkel AI is seeking a Staff or Senior Research Scientist to collaborate with partners and lead the development of frontier benchmarks and datasets. This highly visible, cross-functional role sits at the intersection of research, company strategy, and go-to-market.

You will design datasets considering frontier model performance and work with academic partners to scale impact across customers. You’ll also partner with delivery, product and GTM to operationalize research discoveries, translate

Qualifications

• Strong research background in AI/ML evaluation and NLP.
• Exceptional communication skills for technical and non-technical audiences.
• Comfort operating in fast-moving, cross-functional environments with ambiguity.
• Genuine interest in GTM strategy, startup dynamics, and commercial AI data services.
• Ph.D. in ML, NLP, or related field preferred; equivalent industry or research lab experience considered.

Responsibilities

• Design state-of-the-art datasets that drive frontier model training and evaluation.
• Translate benchmark insights into clear narratives showing ROI of data for customers.
• Collaborate with data operations, product, engineering, and strategy to surface research findings.
• Stay at the frontier of LLM evaluation research and bring best practices to Snorkel workflows.
• Represent Snorkel externally through publications, talks, and customer engagements.

Skills

Research experience

AI/ML evaluation

NLP

Experimental design

Communication

Education

Ph.D. in ML/NLP or related field

Job description

Snorkel AI is seeking a Staff or Senior Research Scientist to collaborate with partners and lead the development of frontier benchmarks and datasets. This highly visible, cross-functional role sits at the intersection of research, company strategy, and go-to-market.

You will design datasets considering frontier model performance and work with academic partners to scale impact across customers. You’ll also partner with delivery, product and GTM to operationalize research discoveries, translate