Frontier AI Evaluation & Environments Engineer

OpenAI; California (MO); On-site; USD 180,000 - 240,000; Full time

Job summary

OpenAI is seeking a Researcher for Frontier Evals & Environments to help create north star model environments that drive progress toward safe AGI/ASI. You will guide research programs behind OpenAI’s ambitious training runs and work with researchers, engineers, product teams, infrastructure, and safety partners.

You will help decide what goes into major model runs, measure outcomes, and ship improvements that affect products used by developers, enterprises, and everyday users.

Qualifications

• Strong technical fundamentals in machine learning, software engineering, systems, or statistics.
• Hands-on experience with LLMs, RL, RLHF/RLAIF, post-training, evals, graders, synthetic data, or production ML systems.
• Comfortable with open-ended problems requiring research taste and engineering execution.

Responsibilities

• Create ambitious RL environments to push models to their limits and measure frontier model capabilities, skills, and behaviors.
• Develop new methodologies for automatically exploring model behavior.
• Dive deep into the science of measurement, including scalability, reliability, and variance of evaluation methods.
• Help steer training for large runs and see future implications of improvements.
• Design scalable systems and processes to support continuous evaluation.
• Build self-improvement loops to automate model understanding.

Skills

ML fundamentals

Software engineering

Systems

Statistics

LLMs

RL/RLHF

Post-training evals

Tool-using agents

Production ML

Job description

OpenAI is seeking a Researcher for Frontier Evals & Environments to help create north star model environments that drive progress toward safe AGI/ASI. You will guide research programs behind OpenAI’s ambitious training runs and work with researchers, engineers, product teams, infrastructure, and safety partners.

You will help decide what goes into major model runs, measure outcomes, and ship improvements that affect products used by developers, enterprises, and everyday users.