Senior ML Engineer: 3D Sensor Simulation for AVs

Frontdoor Defense; Foster City (CA); Hybrid; USD 242,000 - 348,000; Full time

Job summary

Zoox is seeking a Senior / Staff Machine Learning Engineer to advance ML-driven sensor models for 3D sensor simulation, including LiDAR, radar, and camera realism in AV simulations.

You will design, train, and validate ML models, collaborate on 3D reconstruction with NeRF-based methods, and build datasets from real and simulated sensors. Mentoring and developing ML training pipelines are key parts of the role.

Qualifications

• 2+ years of prior experience as a Technical Lead.
• 5+ years of experience developing ML models in Python with PyTorch or TensorFlow.
• Industry experience applying ML to sensor data (lidar, radar, and/or cameras).
• Solid understanding of customizing, tuning, and validating ML training pipelines.
• Experience with diffusion, flow matching, or VAEs.
• Experience with 3D reconstruction (3DGS, NeRFs) or differentiable rendering.
• Prior experience developing autonomy in AVs or robotics.

Responsibilities

• Design, train, and validate ML models that improve the realism of simulated lidar, radar, and camera data in autonomous vehicle (AV) simulation pipelines.
• Collaborate with Synthetic Data and HIL Sim teams to integrate 3DGS and NeRF-based 3D reconstruction with simulation of all sensor modalities.
• Build and curate training datasets from real and simulated sensor data, including GenAI-based data augmentation.
• Partner with Sim V&V and Perception engineers to define sensor realism metrics and close the sim-to-real gaps with the greatest impact on autonomy.
• Mentor engineers and interns, and establish best practices for training and deploying ML on Zoox sensor data.

Skills

Technical Lead

ML model development

Sensor data ML

ML pipelines

Tools

PyTorch

TensorFlow

Python

3D Reconstruction

Job description

Zoox is seeking a Senior / Staff Machine Learning Engineer to advance ML-driven sensor models for 3D sensor simulation, including LiDAR, radar, and camera realism in AV simulations.

You will design, train, and validate ML models, collaborate on 3D reconstruction with NeRF-based methods, and build datasets from real and simulated sensors. Mentoring and developing ML training pipelines are key parts of the role.