Research Engineer, Large Behavior Models - Computer Vision

Toyota Research Institute; Los Altos (CA); On-site; USD 152,000 - 228,000; Full time

Job summary

A leading technology company seeks a Research Engineer to contribute to the development of AI-powered robots using advanced simulation techniques. The ideal candidate will work at the intersection of machine learning, computer vision, and robotics, driving innovative research and implementation in high-fidelity simulation environments.

Benefits

Generous benefits package

401(k) eligibility

Paid time off benefits

Annual cash bonus structure

Qualifications

• 2+ years of professional experience in AI/ML.
• Proficient in Python and simulation frameworks.
• Extensive experience with PyTorch.

Responsibilities

• Develop and manage physics-based robot simulation environments.
• Integrate and validate learned policies in simulation.
• Train and fine-tune robot foundation models.

Skills

Python

Simulation frameworks

Robotics simulation

Reinforcement learning

Machine Learning

Computer vision

MLOps

Software engineering best practices

Education

Professional engineering experience at an AI/ML-focused organization

Tools

Drake

PyBullet

MuJoCo

PyTorch

Job description

Research Engineer, Large Behavior Models - Computer Vision

Research Engineer, Large Behavior Models - Computer Vision

Get AI-powered advice on this job and more exclusive features.

We’re looking for a motivated research engineer to help build the next generation of AI-powered robots through high-fidelity simulation and large behavior models. You’ll work at the intersection of machine learning, computer vision, robotics, and physics-based simulation to enable scalable, generalizable robot policy development. Experience with simulation or embodied systems (robots, autonomous vehicles, etc.) is a strong plus.

If our mission of revolutionizing robot learning through simulation and large behavior models resonates with you, we’d love to talk about how we can build it together.

We’re looking for a motivated research engineer to help build the next generation of AI-powered robots through high-fidelity simulation and large behavior models. You’ll work at the intersection of machine learning, computer vision, robotics, and physics-based simulation to enable scalable, generalizable robot policy development. Experience with simulation or embodied systems (robots, autonomous vehicles, etc.) is a strong plus.

If our mission of revolutionizing robot learning through simulation and large behavior models resonates with you, we’d love to talk about how we can build it together.

Responsibilities

• Develop and manage physics-based robot simulation environments using Drake, enabling scalable training and evaluation of learning-based behavior models in realistic, physically grounded scenarios.
• Integrate and validate learned policies in simulation, assessing real-world applicability, generalization, and performance across diverse environments, tasks, geometries, and sensor viewpoints.
• Build, improve, and robustify end-to-end integrated ML pipelines for training multimodal (language, images, 3D, video, actions) models at scale.
• Train, fine-tune, and serve robot foundation models with a strong MLOps approach.
• Build processes for integrating collaboration-produced and open-source advancements and code into our internal stack.
• Collaborate with internal research scientists and our partner labs at top academic institutions and Toyota research labs to drive groundbreaking research at scale.

Qualifications

• 2+ years of professional engineering experience at an AI/ML-focused organization.
• Strong proficiency in Python and experience with simulation frameworks such as Drake, PyBullet, MuJoCo, or similar.
• Hands-on experience with robotics simulation, reinforcement learning, or large-scale machine learning.
• Familiarity with the latest methods in behavior learning and/or computer vision.
• Experience integrating ML models into simulated or real-world environments.
• Extensive practical experience with PyTorch.
• Ability to alternate between rapid prototyping and production-quality implementation.
• Demonstrated understanding of software engineering best practices, including testing, CI/CD, and documentation.

Bonus Qualifications

• Experience deploying models on embodied systems/robots.
• Experience working in mixed teams of research scientists and engineers.
• Exposure to MLOps tools and infrastructure (e.g., Docker, EC2, S3, Sagemaker).
• Experience with Bazel.

The pay range for this position at commencement of employment is expected to be between$152,000 and $228,000/year for California-based roles; however, base pay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience. Note that TRI offers a generous benefits package (including 401(k) eligibility and various paid time off benefits, such as vacation, sick time, and parental leave) and an annual cash bonus structure. Details of participation in these benefit plans will be provided if an employee receives an offer of employment.

Please reference this Candidate Privacy Notice to inform you of the categories of personal information that we collect from individuals who inquire about and/or apply to work for Toyota Research Institute, Inc. or its subsidiaries, including Toyota A.I. Ventures GP, L.P., and the purposes for which we use such personal information.

TRI is fueled by a diverse and inclusive community of people with unique backgrounds, education and life experiences. We are dedicated to fostering an innovative and collaborative environment by living the values that are an essential part of our culture. We believe diversity makes us stronger and are proud to provide Equal Employment Opportunity for all, without regard to an applicant’s race, color, creed, gender, gender identity or expression, sexual orientation, national origin, age, physical or mental disability, medical condition, religion, marital status, genetic information, veteran status, or any other status protected under federal, state or local laws.

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability. Pursuant to the San Francisco Fair Chance Ordinance, we will consider qualified applicants with arrest and conviction records for employment.

Seniority level

• Seniority level

  Entry level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering and Information Technology

• Industries

  Research Services

Referrals increase your chances of interviewing at Toyota Research Institute by 2x

Get notified about new Research Engineer jobs in Los Altos, CA.

Menlo Park, CA $85.10-$251,000.00 2 weeks ago

Sunnyvale, CA $85.10-$251,000.00 2 weeks ago

Sunnyvale, CA $124,000.00-$155,000.00 1 week ago

Sunnyvale, CA $124,000.00-$155,000.00 1 week ago

Milpitas, CA $115,900.00-$197,000.00 2 weeks ago

Menlo Park, CA $213,000.00-$293,000.00 2 weeks ago

Palo Alto, CA $100,000.00-$220,000.00 1 month ago

Santa Clara, CA $75,000.00-$170,000.00 1 month ago

Scientist I/II, Translational Science & Biomarkers

Redwood City, CA $127,000.00-$142,000.00 5 days ago

Sunnyvale, CA $177,000.00-$251,000.00 2 weeks ago

Menlo Park, CA $177,000.00-$251,000.00 2 weeks ago

Scientist: Robot Learning for AI Supported Teleoperation ...

Research Scientist (AI) – Biomedical Imaging

R&D Engineer, Detector Design, Model, and Analysis

Research Scientist, AI/ML, Health Sensing and Insights

Mountain View, CA $141,000.00-$202,000.00 1 week ago

SEAL Research Scientist/ Research Engineer

Stanford, CA $160,000.00-$200,000.00 1 week ago

Research Scientist- Vision-Language-Action Models for Autonomous Systems

Sunnyvale, CA $160,000.00-$200,000.00 6 days ago

Sunnyvale, CA $213,000.00-$293,000.00 2 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.