Lead ML Research Engineer, Multimodal Driving Models

Fruition Group US

San Francisco (CA)

On-site

USD 200,000 - 260,000

Full time

4 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Fruition Group US is partnering with a fast-growing autonomous vehicle company to hire a Staff Machine Learning Research Engineer. You will work on large multimodal models that interpret what the vehicle sees and decide next actions, with end-to-end involvement from dataset shaping to onboard deployment.

The role emphasizes taking models from experiments to real-world tests on vehicles, with options to lead a major research thread, implement training pipelines, and shrink models to fit onboard

Qualifications

  • 5+ years building and training deep learning models in PyTorch, TensorFlow, or JAX.
  • Experience taking models from training to production.
  • Strong knowledge of multimodal models, transformers, diffusion, and flow matching.
  • Experience with large-scale or distributed training.
  • Background with camera, lidar, radar data; publications or autonomous driving experience is a plus.

Responsibilities

  • Build, train, and test vision-language-action models for driving decisions.
  • Lead a major research thread, from data and design to large-scale training.
  • Create training/evaluation pipelines with rigorous driving-scenario metrics.
  • Develop model compression to run onboard on vehicle hardware.
  • Apply supervised fine-tuning and RL to improve reasoning and reliability.
  • Collaborate with perception, planning, and platform teams to productionize research.

Skills

Deep learning frameworks (PyTorch, TF,

Education

Master's degree in CS/EE/Math/Stats or related field
PhD in related field preferred

Tools

ONNX
TensorRT

Job description

Fruition Group US is partnering with a fast-growing autonomous vehicle company to hire a Staff Machine Learning Research Engineer. You will work on large multimodal models that interpret what the vehicle sees and decide next actions, with end-to-end involvement from dataset shaping to onboard deployment.

The role emphasizes taking models from experiments to real-world tests on vehicles, with options to lead a major research thread, implement training pipelines, and shrink models to fit onboard

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Machine Learning Engineer
Staff Machine Learning Engineer

Fruition Group US • San Francisco (CA)

On-site
USD 200,000 - 260,000
Hybrid Staff ML Engineer Perception & Multimodal Models
Hybrid Staff ML Engineer Perception & Multimodal Models

Waymo • Kirkland (WA)

Hybrid
USD 251,000 - 310,000
Health insurance
Dental insurance
Vision insurance
+7
Senior ML Engineer: Multimodal Simulation Evaluations
Senior ML Engineer: Multimodal Simulation Evaluations

Waymo LLC • United States

Remote
USD 180,000 - 230,000
Staff ML Engineer - Large Driving Model for Autonomy
Staff ML Engineer - Large Driving Model for Autonomy

Rivian Automotive • Palo Alto (CA)

On-site
USD 210,000 - 285,000
Senior Multimodal Perception Scientist for Driving AI
Senior Multimodal Perception Scientist for Driving AI

Waymo • San Francisco (CA)

Hybrid
USD 251,000 - 310,000
Health, dental, vision, life, disability insurance
401(k) with company match
20 days of vacation per year
+2
Staff ML Engineer, Large Driving Model (LDM) for Autonomy
Staff ML Engineer, Large Driving Model (LDM) for Autonomy

Rivian Automotive • Irvine (CA)

On-site
USD 210,000 - 285,000
Annual bonus
Equity awards
401(k) plan
+2
Senior Multimodal ML Research Engineer
Senior Multimodal ML Research Engineer

Origin Lab • Los Angeles (CA)

On-site
USD 180,000 - 280,000
Staff ML Engineer – 3D Perception & Multimodal Models
Staff ML Engineer – 3D Perception & Multimodal Models

Waymo • San Francisco (CA)

Hybrid
USD 251,000 - 310,000
Health, dental, vision insurance
401(k) with company match
20 days PTO per year
+2
Senior ML Engineer: BEV & Multi-Modal Perception
Senior ML Engineer: BEV & Multi-Modal Perception

Torc Robotics • Ann Arbor (MI)

Hybrid
USD 216,000 - 259,000
Stock options
Excellent benefits
401K with match
+5
Staff ML Engineer — Hybrid 3D Perception & Multimodal
Staff ML Engineer — Hybrid 3D Perception & Multimodal

Waymo • New York (NY)

Hybrid
USD 251,000 - 310,000
Health, dental, vision
401(k) with company match
Paid Time Off
+4