ML Engineer - 3D Sensor Simulation for AVs

Zoox; Foster City (CA); On-site; USD 189,000 - 283,000; Full time

Benefits offered by this job

Health insurance

Zoox Stock Appreciation Rights

Amazon RSUs

Paid time off

Long-term care insurance

Disability insurance

Life insurance

Job summary

Zoox seeks a machine learning professional to advance ML models for LiDAR, radar, and camera realism in autonomous vehicle simulation. You will design, train, and validate models within our 3D sensor simulation framework and collaborate across teams to reduce sim-to-real gaps.

You will curate real and synthetic datasets, apply GenAI-based augmentation, and mentor engineers while shaping best practices for ML deployment on Zoox sensor data.

Qualifications

• 3+ years of experience developing ML models in Python with PyTorch or TensorFlow.
• Industry experience applying ML to sensor data (lidar, radar, and/or cameras)
• Solid understanding of customizing, tuning, and validating ML training pipelines

Responsibilities

• Design, train, and validate ML models that improve the realism of simulated lidar, radar, and camera data in AV simulation pipelines.
• Collaborate with Synthetic Data and HIL Sim teams to integrate 3DGS and NeRF-based 3D reconstruction with simulation of all sensor modalities.
• Build and curate training datasets from real and simulated sensor data, including GenAI-based data augmentation.
• Partner with Sim V&V and Perception engineers to define sensor realism metrics and close the sim-to-real gaps with the greatest impact on autonomy.
• Mentor engineers and interns, and establish best practices for training and deploying ML on Zoox sensor data.

Skills

ML models in Python

Sensor data ML

ML training pipelines

Job description

Zoox seeks a machine learning professional to advance ML models for LiDAR, radar, and camera realism in autonomous vehicle simulation. You will design, train, and validate models within our 3D sensor simulation framework and collaborate across teams to reduce sim-to-real gaps.

You will curate real and synthetic datasets, apply GenAI-based augmentation, and mentor engineers while shaping best practices for ML deployment on Zoox sensor data.