Research Scientist - Data-Centric AI & Frontier Benchmarks

Snorkel AI; New York (NY); On-site; USD 233,000 - 316,000; Full time

Job summary

Snorkel AI is seeking a Research Scientist to collaborate with partners and lead the development of next frontier benchmarks and datasets. This highly visible, customer-facing role sits at the intersection of research, company strategy, and go-to-market, designing datasets with frontier model performance in mind.

You will work with academic partners and cross-functional teams to scale production, serve as a credible technical partner for customers, prospects, and drive results that impact the

Qualifications

• Strong research background in AI/ML evaluation and NLP.
• Exceptional communication skills for presenting to technical and non-technical audiences.
• Comfort operating in fast-moving, cross-functional environments with ambiguous problems.

Responsibilities

• Design state-of-the-art datasets and benchmarks for frontier models.
• Translate benchmark insights into narratives that articulate ROI to customers and partners.
• Collaborate with data operations, product, engineering, and strategy to inform the roadmap.
• Stay at the frontier of LLM evaluation research and integrate best practices.
• Represent Snorkel AI through publications, talks, and customer engagements.

Skills

Research leadership

AI/ML evaluation

Data-driven storytelling

Cross-functional collaboration

Education

PhD in ML/NLP

Job description

Snorkel AI is seeking a Research Scientist to collaborate with partners and lead the development of next frontier benchmarks and datasets. This highly visible, customer-facing role sits at the intersection of research, company strategy, and go-to-market, designing datasets with frontier model performance in mind.

You will work with academic partners and cross-functional teams to scale production, serve as a credible technical partner for customers, prospects, and drive results that impact the