Research Scientist Intern, Robotics Foundation Models, Agentic RL (PhD)

Meta

Menlo Park (CA)

On-site

USD 55,000 - 83,000

Full time

13 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Meta Reality Labs Research in Menlo Park is seeking a Research Scientist Intern to develop scalable offline reinforcement learning methods for post-training these models. Interns will conduct both fundamental and applied research to advance foundation models for robotics, focusing on post-training.

You will collaborate with researchers and engineers to build and evaluate model capabilities, design experiments, and publish results at leading ML and robotics venues.

Qualifications

  • PhD candidate or degree in CS/ML/Robotics.
  • Experience in RL including policy optimization and offline/off-policy learning.
  • Experience implementing and training deep learning models with Python and PyTorch.
  • Ability to design controlled experiments and analyze results.
  • Collaborative cross-group communication.

Responsibilities

  • Develop agentic RL algorithms for post-training WAMs and VLAs using large robot datasets.
  • Investigate reward learning, value estimation, and policy optimization for generative action models.
  • Address learning from mixed-quality experience, distribution shift, sparse rewards and long-horizon credit.
  • Build training and data pipelines; study how policy performance scales with data and compute.
  • Design experiments and benchmarks to evaluate policy generalization across tasks and environments.
  • Collaborate with researchers and engineers to evaluate policies in simulation and on real robots.
  • Communicate research findings and publish results at leading ML and robotics venues.

Skills

Reinforcement learning
Python
PyTorch
Offline RL
Robotics
Experiment design
Distributed training
Mathematical foundations

Education

PhD in CS/ML/Robotics

Tools

PyTorch
Python
Linux

Job description

Meta Reality Labs Research is a team of researchers and engineers pushing the frontier of AI and robotics. Our team is building the next generation of world action models (WAMs) and vision-language-action models (VLAs) for robotic manipulation. We are seeking a Research Scientist Intern to develop scalable offline reinforcement learning methods for post-training these models.

Interns in this role will conduct fundamental and applied research to advance foundation models for robotics, with a focus on post-training. You will collaborate with research scientists and engineers to develop new algorithms, build and evaluate model capabilities, and contribute to the next generation of embodied AI.

Our internships are twelve (12) to twenty-four (24) weeks long and we have various start dates throughout the year.

Responsibilities

Develop agentic RL algorithms for post-training WAMs and VLAs using large, heterogeneous robot datasets.
Investigate agentic RSI, reward learning, value estimation, and policy optimization for generative action models, including approaches that use learned world models to support policy improvement.
Address challenges in learning from mixed-quality experience, including distribution shift, sparse rewards, and long-horizon credit assignment.
Build efficient training and data pipelines, and study how policy performance scales with dataset size, model capacity, and compute.
Design experiments and benchmarks to evaluate policy improvement and generalization across tasks and environments.
Collaborate with research scientists and engineers to evaluate learned policies in simulation and on real robots.
Communicate research findings and publish results at leading machine learning and robotics venues.

Qualifications

Currently has or is in the process of obtaining a Ph.D. degree in Computer Science, Machine Learning, Artificial Intelligence, Robotics, or a related STEM field
Research experience in reinforcement learning, including policy optimization, value learning, or offline/off-policy learning
Experience implementing and training deep learning models using Python and PyTorch or a comparable framework
Experience designing controlled experiments, analyzing results, and debugging machine learning algorithms
Interpersonal experience: cross-group and cross-culture collaboration
Must obtain work authorization in country of employment at the time of hire and maintain ongoing work authorization during employment Intent to return to degree program after the completion of the internship/co-op
Experience developing offline RL methods, particularly for continuous control, large datasets, or learning from suboptimal experience
Experience training or post-training VLAs, WAMs, or other foundation models for embodied decision-making
Experience with diffusion or flow-based policies, action-sequence prediction, model-based RL, or action-conditioned world models
Hands-on experience with distributed training across multiple GPUs or nodes, including improving training throughput, memory efficiency, and stability
Experience evaluating learned policies on physical robots or robotics simulation benchmarks
Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, and/or accepted papers in top conferences or journals such as NeurIPS, ICML, ICLR, CoRL, RSS, ICRA, CVPR, ICCV, ECCV, ACL, etc

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Scientist Intern - Robotics Foundation Models - Agentic RL
Research Scientist Intern - Robotics Foundation Models - Agentic RL

Meta • Menlo Park (CA)

On-site
USD 41,000 - 69,000
Research Intern – Robot Learning - Imitation Learning, Foundation Models, RL (MS/PhD, 6–12 months)
Research Intern – Robot Learning - Imitation Learning, Foundation Models, RL (MS/PhD, 6–12 months)

Proception Inc. • Mountain View (CA)

Hybrid
USD 41,000 - 55,000
Research Scientist Intern: Robotics Foundation Models & RL
Research Scientist Intern: Robotics Foundation Models & RL

Meta • Menlo Park (CA)

On-site
USD 41,000 - 69,000
Research Scientist Intern: Agentic RL for Robotic Models
Research Scientist Intern: Agentic RL for Robotic Models

Meta • Menlo Park (CA)

On-site
USD 55,000 - 83,000
Research Scientist Intern - Multimodal Learning for Robotics - PhD
Research Scientist Intern - Multimodal Learning for Robotics - PhD

Meta • Burlingame (CA)

On-site
USD 44,000 - 66,000
Research Scientist Intern, Policy Learning for Robotics (PhD)
Research Scientist Intern, Policy Learning for Robotics (PhD)

Meta • Redmond (WA)

On-site
USD 55,000 - 83,000
Research Scientist Intern - PhD — Meta Superintelligence Labs
Research Scientist Intern - PhD — Meta Superintelligence Labs

Meta • Menlo Park (CA)

On-site
USD 55,000 - 69,000
RL AI Research Intern
RL AI Research Intern

Pokee AI • United States

Remote
USD 20,000 - 33,000
Publications or preprints
Remote internship
Mentorship from researchers
Robotics Research Intern
Robotics Research Intern

Talex, Inc. • United States

Remote
USD 27,000 - 40,000
Health insurance
401(k)
Generous PTO
Research Intern
Research Intern

Rhoda AI • Mountain View (CA)

On-site
USD 20,000 - 33,000