Frontier Agent Evals & Environments Research Scientist

OpenAI; San Francisco (CA); On-site; USD 380,000 - 500,000; Full time

Job summary

OpenAI in San Francisco is seeking an Agent Post-Training researcher for Frontier Evals & Environments. You will help build north star model environments to drive progress toward safe AGI/ASI and guide the research programs behind our largest training runs.

You will collaborate with researchers, engineers, product teams, infrastructure, and safety partners to decide what goes into major model runs, measure outcomes, and ship improvements used by real people.

Responsibilities

• Create ambitious RL environments to push our models to their limits, and measure frontier model capabilities, skills, and behaviors
• Develop new methodologies for automatically exploring the behavior of these models
• Dive deep into the science of measurement, including understanding scalability, reliability, and variance of our evaluation methodology
• Help steer training for our largest training runs, and see the future first
• Design scalable systems and processes to support continuous evaluation
• Build self-improvement loops to automate model understanding

Job description

OpenAI in San Francisco is seeking an Agent Post-Training researcher for Frontier Evals & Environments. You will help build north star model environments to drive progress toward safe AGI/ASI and guide the research programs behind our largest training runs.

You will collaborate with researchers, engineers, product teams, infrastructure, and safety partners to decide what goes into major model runs, measure outcomes, and ship improvements used by real people.