Member of Technical Staff - Research

Patronus AI; San Francisco (CA); On-site; USD 180,000 - 260,000; Full time

Job summary

Patronus AI is a frontier lab accelerating progress toward human-aligned AGI, focused on simulation research and infrastructure. We are seeking a Researcher to own foundational research at the intersection of reinforcement learning, simulations, and scalable oversight, translating questions into rigorous experiments, benchmarks, and production-ready systems.

This highly autonomous role emphasizes designing environments, evaluating frontier agents, and publishing or open-sourcing work.

Qualifications

• MS or PhD in Computer Science, ML, Statistics, Mathematics, or related field.
• Experience conducting independent RL/NLP or agentic research.
• Ability to translate open-ended problems into rigorous experiments.

Responsibilities

• Own ambitious research projects end-to-end from problem formulation to production impact.
• Advance research in agent simulation, RL, and scalable oversight.
• Design state-of-the-art simulation environments for frontier agents.
• Train models and run ablations with open-source models and distillation techniques.
• Publish findings and contribute to research direction.

Skills

Python programming

Experiment design

Reinforcement learning

Communication

Research collaboration

Education

MS or PhD in CS/ML/Math

Tools

PyTorch

TensorFlow

Job description

Patronus AI is a frontier lab developing simulation research and infrastructure to accelerate progress toward human-aligned AGI. We are on a mission to simulate all of the world's intelligence.

We are the team behind some of the earliest and most influential research in AI evaluation like FinanceBench, Lynx, SimpleSafetyTests, CopyrightCatcher, Humanity's Last Exam, and more. We are formerly AI researchers and engineers from companies like Meta AI, Amazon AGI, and Google. Our customers include foundation model labs and Fortune 500 enterprises like Adobe. We are backed by top-tier investors like Lightspeed Venture Partners, Notable Capital, Stanford University, Noam Brown, Gokul Rajaram, and more.

Responsibilities

As a Researcher at Patronus AI, you will own and drive foundational research that defines how agentic AI systems are trained, evaluated, and improved. You will work at the intersection of reinforcement learning, simulations, and scalable oversight, building systems that directly influence how frontier models are developed, stress-tested, and deployed.

This is a highly autonomous role. You will tackle open-ended research questions surrounding agent simulations and translate them into rigorous experiments, benchmarks, environments, and production systems. You will work across areas including reward design, tool simulations, agent cognition, behavior analysis, and scalable oversight, helping shape the industry standard for robust, high-quality environments.

Your work will inform how frontier labs design, train, evaluate, and improve the next generation of agents for complex, long-horizon tasks, advancing our path toward safe, human-aligned general intelligence.

In this role, you will:

• Own ambitious research projects end-to-end, from identifying and formulating open-ended problems through experiment design, execution, analysis, and production impact.
• Advance research in agent simulation, reinforcement learning, and scalable oversight, including agent cognition, behavior analysis, reward design, and new training methods.
• Design state-of-the-art simulation and RL environments for training and evaluating frontier agents, spanning tools and actions, observations and state, trajectories, curricula, and reward systems.
• Train models and experiment with post-training algorithms, including GRPO and SFT. Run ablations with open source models and understand the impact of distillation, COT reasoning, sparse and dense rewards and hyperparameters.
• Develop methods to understand and improve agent behavior across complex, long-horizon tasks, including reasoning, planning, adaptation, generalization, and reward hacking.
• Run rigorous experiments and turn findings into measurable outcomes, including new techniques, benchmarks, datasets, environments, platform capabilities, and research publications.
• Build high-quality, reproducible research systems, writing production-level code and partnering closely with engineering and product to translate research into real-world systems.
• Contribute to Patronus AI's research direction and thought leadership, staying at the frontier of the field, collaborating with the research community, and publishing or open sourcing our work.

Qualifications

"The number one qualification to succeed in this machine learning course is gumption" - John Lafferty, CS Professor at Yale

Above all, we look for an eagerness to learn, passion for research, creativity in problem solving and a proactive mindset. You are a great fit if you have a background in the following:

• An MS or PhD in Computer Science, Machine Learning, Statistics, Mathematics, or a related quantitative field.
• Experience conducting independent research in reinforcement learning, NLP, agentic systems, evaluation, alignment, or related areas.
• Demonstrated ability to take open-ended research problems from 0-1 and deliver high-impact outcomes.
• Strong experimental skills, including experiment design, analysis, and interpretation of results.
• Experience writing clean, reproducible research code in Python and modern machine learning frameworks.
• Ability to execute quickly and independently with minimal guidance while maintaining a high bar for research quality.
• Experience collaborating cross-functionally with research, engineering, and product teams.
• Clear written and verbal communication skills, including the ability to explain complex technical ideas succinctly.
• Strong integrity, good judgment, and respect for others.

To support close collaboration, this role is based in our San Francisco headquarters and requires in-office attendance five days a week.