Research Scientist, AI Safety & Benchmark Design

Plato; San Francisco (CA); Vor Ort; USD 180.000 - 240.000; Vollzeit

Zusammenfassung

Plato is hiring an individual contributor researcher to design safety environments and benchmarks, starting with evaluations that measure how AI models can improve themselves and other models. You will establish a new research direction at Plato, designing safety-relevant benchmarks and working with engineers to turn them into runnable environments.

Your initial focus will be measuring AI R&D capabilities, including experiment design, model training, and research replication.

Qualifikationen

• Recent hands-on work evaluating frontier models, benchmarks, or AI safety in the past year or two.
• Contributions to papers, benchmarks, or empirical reports valued over credentials.
• Clear understanding of frontier model capabilities, limits, and likely progress.

Aufgaben

• Design safety benchmarks measuring AI research automation and self-improvement.
• Build environments exposing reward hacking, sabotage, deception, and constraint violations.
• Hold evaluation quality by examining contamination, grader weaknesses, ambiguity, and shortcuts.

Kenntnisse

Frontier-model eval

AI safety

Experimental design

Research ownership

Critical thinking

Team collaboration

Jobbeschreibung

Plato is hiring an individual contributor researcher to design safety environments and benchmarks, starting with evaluations that measure how AI models can improve themselves and other models. You will establish a new research direction at Plato, designing safety-relevant benchmarks and working with engineers to turn them into runnable environments.

Your initial focus will be measuring AI R&D capabilities, including experiment design, model training, and research replication.