Postdoctoral Researcher, Post-Training and Continual Adaptation for Robotics

Toyota Research Institute Inc.; Cambridge (MA); On-site; USD 137,000 - 197,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401(k)

Job summary

Toyota Research Institute (TRI) seeks a postdoctoral researcher to advance post-training and adaptation for generative robot policies. You will work with robotics and machine learning researchers on a focused project, developing new methods and validating them through experiments in simulation and on real robots.

You will design rigorous experiments to evaluate policy improvement, robustness, and retention of capabilities, and communicate findings through publications.

Qualifications

• Ph.D. in robotics, ML, CS or related field completed by start of appointment.
• Strong publication record in RL or related robot-learning methods.
• Proficient programming and experimental skills with DL frameworks and robotics.

Responsibilities

• Develop methods for post-training and adapting pretrained robot policies.
• Design experiments to evaluate policy improvement, robustness, and retention.
• Collaborate with researchers and publish findings in top venues.

Skills

Reinforcement learning

Imitation learning

Robotics

PyTorch

JAX

Experimentation

Scientific research planning

Education

Ph.D. in robotics, machine learning, computer science, or related field

Tools

PyTorch

JAX

Job description

At Toyota Research Institute (TRI), we’re on a mission to improve the quality of human life. We’re developing new tools and capabilities to amplify the human experience. To lead this transformative shift in mobility, we’ve built a world-class team advancing the state of the art in AI, robotics, driving, and material sciences.

The Opportunity

We are seeking a postdoctoral researcher to advance post-training and adaptation for generative robot policies. Our goal is to enable pretrained policies to improve task performance, adapt to human preferences, and acquire new behaviors from limited experience while preserving existing capabilities.

You will work closely with our robotics and machine learning researchers on a focused project, developing new methods and validating them through experiments in simulation and on real robots.

The Challenge

Pretrained robot policies can perform increasingly broad behaviors, yet improving them for new tasks, environments, and user needs remains difficult. Robot experience is limited, feedback can be imperfect, and adapting a policy can undermine capabilities it already has.

Research directions include learning efficiently from demonstrations, online interaction, and human feedback; using reinforcement learning and related methods to improve and customize pretrained policies; and retaining useful improvements across tasks and over time. The project will pursue a specific question within this agenda, shaped jointly around the researcher’s expertise and the team’s research priorities.

Responsibilities

• Develop methods for post-training and adapting pretrained robot policies, taking a focused research question from initial formulation through experimental validation.
• Design rigorous experiments to evaluate policy improvement, behavioral adaptation, robustness, and retention of existing capabilities relative to robot experience and human effort.
• Collaborate with the research team and communicate findings through publications in leading robotics and machine learning venues.

Qualifications

• Ph.D. in robotics, machine learning, computer science, or a related field, completed by the start of the appointment.
• Strong research background in reinforcement learning, imitation learning, or related robot-learning methods, demonstrated through relevant publications.
• Strong programming and experimental skills, including experience with deep learning frameworks such as PyTorch or JAX and with robotic systems.
• Ability to develop and carry out a scientific research plan in collaboration with other researchers.

Experience with robot foundation models, online adaptation, human feedback, or continual learning is especially relevant.

The pay range for this position at commencement of employment is expected to be between $136,800and $196,650/year for Massachusetts-based roles. Base pay offered will depend on multiple individualized factors, including, but not limited to, a candidate's experience, skills, job-related knowledge, and market location. TRI offers a generous benefits package including medical, dental, and vision insurance, 401(k) eligibility, paid time off benefits (including vacation, sick time, and parental leave), and an annual cash bonus structure. Additional details regarding these benefit plans will be provided if an employee receives an offer of employment.

Please reference this Candidate Privacy Notice to inform you of the categories of personal information that we collect from individuals who inquire about and/or apply to work for Toyota Research Institute, Inc. or its subsidiaries, including Toyota A.I. Ventures GP, L.P., and the purposes for which we use such personal information.

TRI is fueled by a diverse and inclusive community of people with unique backgrounds, education and life experiences. We are dedicated to fostering an innovative and collaborative environment by living the values that are an essential part of our culture. We believe diversity makes us stronger and are proud to provide Equal Employment Opportunity for all, without regard to an applicant’s race, color, creed, gender, gender identity or expression, sexual orientation, national origin, age, physical or mental disability, medical condition, religion, marital status, genetic information, veteran status, or any other status protected under federal, state or local laws.

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability. Pursuant to the San Francisco Fair Chance Ordinance, we will consider qualified applicants with arrest and conviction records for employment.