Frontier AI Benchmark Scientist

Snorkel AI; New York (NY); On-site; USD 200,000 - 350,000; Full time

Job summary

Snorkel AI in New York seeks a Research Scientist to design frontier benchmarks and datasets in collaboration with partners, shaping datasets with model performance in mind and partnering with academic collaborators to scale production.

You’ll serve as a technical partner for customers and prospects, driving results that advance data-centric AI and help translate research insights into go-to-market impact within a cross-functional team.

Qualifications

• Strong research background in AI/ML evaluation, NLP, or related fields.
• Proven track record of rigorous experimental design.
• Excellent communication skills for technical and non-technical audiences.

Responsibilities

• Design state of the art datasets that drive frontier model training and evaluation.
• Translate benchmark insights into clear narratives demonstrating ROI of expert-curated data.
• Collaborate cross-functionally with data operations, product, engineering, and strategy.
• Stay at the frontier of LLM evaluation research and bring best practices to Snorkel's workflows.
• Represent Snorkel externally through publications, blogs, talks, and customer engagements.

Skills

AI/ML evaluation

NLP

Experimental design

Communication skills

GTM strategy interest

PhD preferred

Education

PhD in ML/NLP or related

Job description

Snorkel AI in New York seeks a Research Scientist to design frontier benchmarks and datasets in collaboration with partners, shaping datasets with model performance in mind and partnering with academic collaborators to scale production.

You’ll serve as a technical partner for customers and prospects, driving results that advance data-centric AI and help translate research insights into go-to-market impact within a cross-functional team.