Frontier AI Evaluation Engineer: RL Environments

OpenAI

San Francisco (CA)

On-site

USD 120,000 - 160,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

A leading AI research organization in San Francisco is seeking a Research Engineer focused on pushing the boundaries of frontier models and AGI/ASI measurement. Candidates should have strong engineering and statistical skills, a red-teaming mindset, and the ability to thrive in a fast-paced research environment. This role offers the opportunity to shape innovative AI measurements and build evaluation environments that drive progress.

Qualifications

  • Passionate about AGI/ASI measurement.
  • Strong engineering and statistical analysis skills.
  • Able to operate in a dynamic research environment.

Responsibilities

  • Create ambitious RL environments to push models to limits.
  • Work on measuring frontier model capabilities, skills, and behaviors.
  • Develop methodologies for exploring model behavior.
  • Steer training for large runs and observe future potential.
  • Design systems for continuous evaluation.
  • Build self-improvement loops for model understanding.

Skills

AGI/ASI measurement
Engineering skills
Statistical analysis
Red-teaming mindset
ML research engineering

Job description

A leading AI research organization in San Francisco is seeking a Research Engineer focused on pushing the boundaries of frontier models and AGI/ASI measurement. Candidates should have strong engineering and statistical skills, a red-teaming mindset, and the ability to thrive in a fast-paced research environment. This role offers the opportunity to shape innovative AI measurements and build evaluation environments that drive progress.
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Frontier AI Evaluation Architect
Frontier AI Evaluation Architect

United States Digital Space LLC • San Francisco (CA)

On-site
USD 120,000 - 160,000
Frontier AI Evaluation Scientist
Frontier AI Evaluation Scientist

Neura Market • San Francisco (CA)

On-site
USD 200,000 - 250,000
Frontier RL Evaluation Engineer
Frontier RL Evaluation Engineer

Key Talent Solutions • San Francisco (CA)

On-site
USD 180,000 - 350,000
Research Engineer, Frontier Evals & Environments
Research Engineer, Frontier Evals & Environments

OpenAI • San Francisco (CA)

On-site
USD 120,000 - 160,000
Frontier AI Field Engineer – Research to Delivery Leader
Frontier AI Field Engineer – Research to Delivery Leader

Apply • San Francisco (CA)

Hybrid
USD 120,000 - 160,000
Equity in a fast-growing company
401(k) match
Paid parental leave
+2
Research Engineer, Frontier Evals & Environments
Research Engineer, Frontier Evals & Environments

OpenAI • Los Angeles (CA)

On-site
USD 100,000 - 150,000
Applied Research Engineer - Frontier AI & Data Tools
Applied Research Engineer - Frontier AI & Data Tools

Labelbox • San Francisco (CA)

Hybrid
USD 250,000 - 300,000
Staff AI Research Engineer — Frontier Model Evaluations
Staff AI Research Engineer — Frontier Model Evaluations

Intelligence • San Francisco (CA)

On-site
USD 180,000 - 280,000
Meaningful equity
Software Engineer — RL Environments for Frontier AI
Software Engineer — RL Environments for Frontier AI

Mechanize, Inc. • San Francisco (CA)

On-site
USD 100,000 - 140,000
401k
Health insurance
Dental insurance
+2
Frontier AI Risk Evaluation Scientist
Frontier AI Risk Evaluation Scientist

Scale AI • New York (NY), San Francisco (CA)

On-site
USD 197,000 - 247,000
Comprehensive health insurance
Retirement benefits
Generous PTO
+1