Staff Evaluations Scientist for Open-Weight Models

Reflection AI

Greater London

On-site

GBP 75,000 - 110,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Top-tier compensation
Comprehensive health insurance
Fully paid parental leave
Paid time off and relocation support
Daily lunch and dinner provided

Job summary

An AI research company in Greater London is seeking a candidate for a role focused on evaluating AI models. The position involves conducting comparative analysis, developing evaluation frameworks, and collaborating with various teams to improve model features. Ideal candidates will have strong statistical analysis skills and familiarity with LLM evaluation methodologies. The role is designed for those excited to thrive in a fast-paced startup environment and contribute to groundbreaking AI developments.

Qualifications

  • Strong statistical analysis and experimental design skills to rigorously measure model improvements.
  • Familiarity with LLM evaluation methodologies such as static benchmarks and human preference evals.
  • High agency and thrive in a fast-paced startup environment; bias for impact over process.

Responsibilities

  • Conduct critical comparative analysis to advance understanding of model capabilities.
  • Build and refine evaluation systems and processes for tight feedback loops.
  • Develop generalizable evaluation frameworks for reasoning, alignment, and usefulness.

Skills

Statistical analysis
Experimental design
LLM evaluation methodologies
Collaboration

Job description

An AI research company in Greater London is seeking a candidate for a role focused on evaluating AI models. The position involves conducting comparative analysis, developing evaluation frameworks, and collaborating with various teams to improve model features. Ideal candidates will have strong statistical analysis skills and familiarity with LLM evaluation methodologies. The role is designed for those excited to thrive in a fast-paced startup environment and contribute to groundbreaking AI developments.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI/ML Engineer — RLHF & Model Evaluation (Remote)
AI/ML Engineer — RLHF & Model Evaluation (Remote)

Prolific • Greater London

Remote
GBP 67,299 - 95,850
Staff Evaluations Engineer — AI Benchmarks
Staff Evaluations Engineer — AI Benchmarks

Ai • Greater London

On-site
GBP 85,000 - 130,000
30 days annual leave
Pension plan with 10% employer contrib
Bupa private health cover
+1
AI Research Engineer - LLM Evaluation & Alignment (UK)
AI Research Engineer - LLM Evaluation & Alignment (UK)

Jobgether • United Kingdom

Hybrid
GBP 60,000 - 80,000
Competitive salary
Flexible remote work arrangements
Professional growth opportunities
Open-Model AI Safety Lead: Red Team & Validation | Equity
Open-Model AI Safety Lead: Red Team & Validation | Equity

Reflection AI • Greater London

On-site
GBP 100,000 - 180,000
Top-tier compensation
Comprehensive medical, dental, and vision insurance
Paid parental leave for all new parents
+2
AI/ML Engineer — RLHF & Model Evaluation (Remote)
AI/ML Engineer — RLHF & Model Evaluation (Remote)

Prolific • Sheffield

Remote
GBP 67,249 - 95,779
Senior ML Research Engineer: Model Alignment & Evaluation
Senior ML Research Engineer: Model Alignment & Evaluation

IC Resources • Greater London

On-site
GBP 90,000 - 160,000
Researcher, Training - London
Researcher, Training - London

OpenAI, Inc. • Greater London

Hybrid
GBP 90,000 - 140,000
Relocation assistance
Hybrid work schedule
London office
+1
Staff AI Engineer: Post-Training, RL & Model Alignment
Staff AI Engineer: Post-Training, RL & Model Alignment

Reflection AI • Greater London

On-site
GBP 75,000 - 110,000
Top-tier compensation
Comprehensive medical, dental, vision, life, and disability insurance
Fully paid parental leave
+2
AI Evaluation & Research Lead
AI Evaluation & Research Lead

Marker • Greater London

Hybrid
GBP 120,000 - 150,000
Calm work environment
Creative work opportunities
Growth opportunities
+1
AI Model Evaluation Scientist - Pre-Deployment & Red-Teaming (Equity)
AI Model Evaluation Scientist - Pre-Deployment & Red-Teaming (Equity)

OpenDoorHub • Greater London

On-site
GBP 90,000 - 140,000
Equity