Open-Source ML Scientist & Research Lead

LMArena; San Francisco (CA); On-site; USD 130,000 - 170,000; Full time

Benefits offered by this job

Competitive compensation

Comprehensive health and wellness benefits

Opportunity to work on cutting-edge AI

Culture valuing transparency and community impact

Job summary

A pioneering AI evaluation platform in San Francisco is looking for a Machine Learning Scientist to lead open-source research. You will design experiments to evaluate AI models, develop new methodologies, and analyze human interaction data. The ideal candidate has a PhD in a relevant field and strong expertise in machine learning and programming. This role offers competitive compensation, comprehensive benefits, and the chance to work on cutting-edge AI projects in an inclusive and transparent environment.

Qualifications

• PhD or equivalent research experience in Machine Learning, NLP, or a related field.
• Strong understanding of LLMs and deep learning architectures.
• Experience publishing research in ML or NLP.

Responsibilities

• Design and conduct experiments to evaluate AI model behavior.
• Develop metrics, methodologies, and evaluation protocols.
• Analyze large-scale human voting and interaction data.

Skills

Machine Learning

Natural Language Processing

Statistics

Python

Open Science

Education

PhD or equivalent research experience

Tools

PyTorch

JAX

TensorFlow

Job description

A pioneering AI evaluation platform in San Francisco is looking for a Machine Learning Scientist to lead open-source research. You will design experiments to evaluate AI models, develop new methodologies, and analyze human interaction data. The ideal candidate has a PhD in a relevant field and strong expertise in machine learning and programming. This role offers competitive compensation, comprehensive benefits, and the chance to work on cutting-edge AI projects in an inclusive and transparent environment.