Research Scientist, Scaling RL

Speedrun Talent Network; Menlo Park (CA); On-site; USD 225,000 - 350,000; Full time

Job summary

Periodic Labs in Menlo Park (CA) or Montreal seeks a researcher to advance frontier RL for scientific tasks. You will design experiments to understand how RL scales with compute, model size, data, and reward quality, and develop methods from controlled experiments to large-scale runs like Periodic Neon.

This role requires hands-on experience training LLMs with reinforcement learning, a meticulous, scientific approach, and the ability to prototype small-scale RL setups that transfer to bigger

Qualifications

• Hands-on experience training LLMs with reinforcement learning.
• Detail-oriented, rigorous scientific approach.
• Ability to design small-scale RL experiments transferable to large-scale runs.
• Experience debugging and testing research ideas on a complex training stack.

Responsibilities

• Design experiments to understand RL scaling with compute, model size, data, and reward quality.
• Develop RL algorithms across policy optimization, advantage estimation, exploration, and credit assignment.
• Build adaptive sampling and curriculum methods adjusting task difficulty and rollout counts.
• Study bias and stability during RL training and address policy staleness and train–inference mismatch.
• Improve compute efficiency with hyperparameters, length penalties, and update schedules.

Skills

Reinforcement learning

LLM training

Attention to detail

Small-scale RL experiments

Research experimentation

Education

Bachelor's degree

Job description

About Periodic Labs

We\'re an AI and physical sciences company building state-of-the-art models to accelerate breakthroughs across materials, energy, and beyond. Backed by world-class investors and growing rapidly, we operate at the pace the frontier requires. Our team brings deep expertise, genuine ownership, and a drive to push the boundaries of what\'s scientifically possible.

About the Role

We\'re training frontier models to develop deep scientific knowledge and reasoning for scientific tasks. You\’ll study how RL scales with training compute, develop better algorithms, and take ideas from controlled experiments to our largest runs like Periodic Neon.

What You\'ll Do

• Design experiments to understand how RL performance scales with compute, model size, data, and reward quality, building on work such as ScaleRL
• Develop better RL algorithms, spanning policy optimization, advantage estimation, exploration, and credit assignment for long-horizon RL tasks
• Build adaptive sampling and curriculum methods that adjust task difficulty, problem selection, and the number of rollouts as models improve
• Study bias and stability during RL training, including importance-sampling corrections and methods to tackle policy staleness and training–inference mismatch, as discussed here.
• Improve compute efficiency across training and inference through experiments with hyperparameters, such as length penalties, rollout counts, batch sizes, and update schedules.

You Will Thrive in This Role If You Have

• Hands-on experience training LLMs with reinforcement learning
• Strong attention to detail and rigorous approach to answer questions scientifically.
• Coming up with small-scale RL setups that transfers to large-scale training runs.
• Comfort working across a complex training stack to implement, debug, and test new research ideas.

Mechanics
Minimum education: Bachelor\'s degree or similar experience

Location: Menlo Park, CA or Montreal, Canada

Compensation: $225,000-$350,000 base + equity

Visa sponsorship: Yes, we sponsor visas and will do everything we can to assist in this process.