Open-Source ML Scientist & Research Leader

Arena Intelligence, Inc.; San Francisco (CA); On-site; USD 180,000 - 250,000; Full time

Benefits offered by this job

Competitive compensation

Comprehensive health benefits

Opportunity to work on cutting-edge AI

Culture valuing transparency and community impact

Job summary

A technology organization focused on AI evaluations is seeking a Machine Learning Scientist to lead open-source research initiatives. The candidate will design experiments, develop evaluation protocols, and analyze large-scale user interaction data. Responsibilities include collaborative efforts with engineers and public engagement in the research community. A PhD in a related field and expertise in ML is required. The role offers competitive compensation and a supportive work culture.

Qualifications

• Strong understanding of LLMs and modern deep learning architectures.
• Experience publishing research or working on open-source projects in ML, NLP, or AI evaluation.
• Ability to design and analyze experiments with statistical rigor.

Responsibilities

• Design and conduct experiments to evaluate AI model behavior.
• Develop new metrics, methodologies, and evaluation protocols.
• Analyze large-scale human voting and interaction data.

Skills

Experience training large-scale models

Foundation in ML and statistics

Fluency in experimental stack

Collaborative mindset

Public engagement effectiveness

Education

PhD or equivalent research experience in ML or related field

Tools

Python

PyTorch

JAX

TensorFlow

Job description

A technology organization focused on AI evaluations is seeking a Machine Learning Scientist to lead open-source research initiatives. The candidate will design experiments, develop evaluation protocols, and analyze large-scale user interaction data. Responsibilities include collaborative efforts with engineers and public engagement in the research community. A PhD in a related field and expertise in ML is required. The role offers competitive compensation and a supportive work culture.