Senior ML Researcher: End-to-End Driving with LBM & Diffusion

Toyota Research Institute; Los Altos (CA); On-site; USD 200,000 - 287,500; Full time

Benefits offered by this job

Medical, dental, vision insurance

401(k) eligibility

Paid time off

Annual cash bonus

Job summary

Toyota Research Institute (TRI) is seeking a Senior Machine Learning Researcher to develop a state-of-the-art, pixels-to-action end-to-end system for automated driving. You will design and deploy models on vehicle platforms to handle daily driving tasks and long-tail scenarios.

The role involves leading independent research, mentoring occasionally, and expanding TRI’s LBM and DP research into the driving domain, while collaborating across TRI and Toyota partners and publishing results in top

Qualifications

• PhD or equivalent in a robotics-relevant or embodied-AI field.
• Consistent track record of publishing at high-impact venues (CVPR/ICLR/NeurIPS/etc.).
• Independent researcher with ability to drive a research agenda and collaborate across domains.
• Experience training large-scale models, including foundation models (vision-language/text-to-video).
• Proficiency in Python and C++ for implementing research ideas.

Responsibilities

• Conduct ambitious research to advance end-to-end perception, planning, and prediction for automated driving using generative AI and computer vision.
• Develop scalable end-to-end architectures processing raw sensor data to vehicle trajectories; address long-tail scenarios.
• Prototype, validate, and iterate models using imitation learning with large-scale data.
• Perform closed-loop evaluations in sensor simulations and real-world tests for robustness and scalability.
• Explore multi-modal and language-conditioned models; leverage external data and transfer learning to improve generalization.
• Collaborate with TRI, Woven by Toyota, and Toyota ecosystem to accelerate deployment and evaluation.
• Lead writing and publication of research results in peer-reviewed venues.

Skills

Python

C++

Large-scale models

Foundation models

Education

PhD in robotics or embodied-AI

Job description

Toyota Research Institute (TRI) is seeking a Senior Machine Learning Researcher to develop a state-of-the-art, pixels-to-action end-to-end system for automated driving. You will design and deploy models on vehicle platforms to handle daily driving tasks and long-tail scenarios.

The role involves leading independent research, mentoring occasionally, and expanding TRI’s LBM and DP research into the driving domain, while collaborating across TRI and Toyota partners and publishing results in top