Staff AI Evaluation Scientist

Reflection; San Francisco (CA); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Top-tier compensation

Comprehensive medical, dental, vision, life, and disability insurance

Fully paid parental leave

Paid time off

Daily provided meals

Regular off-site team celebrations

Job summary

Reflection is seeking talented individuals to join our mission of building open superintelligence. The selected candidate will conduct critical analyses and collaborate with various teams to improve models. We offer top-tier compensation, comprehensive health benefits, and a supportive work environment.

If you thrive in a challenging, team-oriented atmosphere and are passionate about AI research, apply to join us at Reflection and help define the boundaries of open foundational models.

Qualifications

• Strong statistical analysis and experimental design skills.
• Familiarity with LLM evaluation methodologies.
• Ability to work in a fast-paced startup environment.

Responsibilities

• Conduct comparative analysis to enhance understanding of model capabilities.
• Refine evaluation systems and processes based on data and model behavior.
• Collaborate close with teams to translate insights into model improvements.

Skills

Statistical analysis

Experimental design

LLM evaluation methodologies

Collaboration

Job description

Reflection is seeking talented individuals to join our mission of building open superintelligence. The selected candidate will conduct critical analyses and collaborate with various teams to improve models. We offer top-tier compensation, comprehensive health benefits, and a supportive work environment.

If you thrive in a challenging, team-oriented atmosphere and are passionate about AI research, apply to join us at Reflection and help define the boundaries of open foundational models.