Frontier AI Benchmarks Scientist (Data-Centric)

Snorkel AI; San Francisco (CA); Hybrid; USD 200,000 - 325,000; Full time

Job summary

Snorkel AI in San Francisco is searching for a Research Scientist to lead the development of datasets and benchmarks for AI models. This customer-facing role involves working with academic partners and cross-functional teams to ensure impactful research outcomes.

The ideal candidate has a Ph.D. in a relevant field and a strong focus on AI/ML evaluation and dataset design. With robust growth opportunities, joining Snorkel offers a unique chance to influence strategic decisions and enhance your career.

Qualifications

• Strong research background in AI/ML evaluation, NLP, or related fields.
• Exceptional communication skills for both technical and non-technical audiences.
• Comfortable in a fast-paced, cross-functional environment.

Responsibilities

• Design datasets for model training and evaluation based on performance and partnerships.
• Translate benchmark insights into clear narratives for technical reports and presentations.
• Work with cross-functional teams to inform the company roadmap.
• Stay updated on LLM evaluation research for Snorkel's workflows.
• Represent Snorkel’s research through publications and presentations.

Skills

AI/ML evaluation

Natural Language Processing

Experimental design

Communication skills

Education

Ph.D. in machine learning, NLP, or a related field

Job description

Snorkel AI in San Francisco is searching for a Research Scientist to lead the development of datasets and benchmarks for AI models. This customer-facing role involves working with academic partners and cross-functional teams to ensure impactful research outcomes.

The ideal candidate has a Ph.D. in a relevant field and a strong focus on AI/ML evaluation and dataset design. With robust growth opportunities, joining Snorkel offers a unique chance to influence strategic decisions and enhance your career.