Senior Machine Learning Engineer - Perception Detection and Tracking

Zoox; Foster City (CA); On-site; USD 170,000 - 230,000; Full time

Job summary

Zoox in Foster City, CA seeks an ML model engineer for detection and tracking on the Object Detection and Tracking team. You will work on developing detection and tracking models, integrating them into the vehicle stack, and leveraging world-class sensor data and testing infrastructure.

You will define architecture for core tracking results, collaborate with model and data teams to build efficient, on-vehicle ML solutions, and work with perception data throughout the pipeline.

Qualifications

• BS or higher in Computer Science or related degree.
• Familiarity with sparse-BEV joint detection and tracking models.
• Hands-on experience with production ML pipelines, including dataset creation, metrics, and optimization.

Responsibilities

• Define on-vehicle architecture for producing the core tracking results from the Perception stack.
• Assist with the implementation of core tracking results from the Perception stack.
• Work with both the model and data teams to develop a high-performance, efficient model that can run on a vehicle.
• Work with Perception data, both on the input and output of machine learning models.

Skills

Python

PyTorch

CUDA

TensorRT

Tracking systems

Probabilistic methods

Education

BS in Computer Science

Job description

The Object Detection and Tracking team at Zoox deals with the perception of all people and objects that can move. Your role is to work on the ML model team to develop detection and tracking models and to integrate them into the vehicle stack.

In this role, you will have access to the world's best sensor data and an incredible infrastructure for testing and validating your algorithms. We are creating new algorithms for detection, tracking, classification, and high-level scene understanding, and you could work on any (or all!) of these components.

• Define on-vehicle architecture for producing the core tracking results from the Perception stack.
• Assist with the implementation of core tracking results from the Perception stack
• Work with both the model and data teams to develop a high-performance, efficient model that can run on a vehicle.
• Work with Perception data, both on the input and output of machine learning models

• BS or higher in Computer Science or a related degree
• Familiarity with modern, Sparse-BEV Joint Detection and Tracking models.
• Hands-on experience with production ML pipelines, including dataset creation, metrics, and optimization
• Experience in Python, PyTorch, or a related ML framework
• Experience with CUDA code and/or TensorRT
• Strong mathematical skills and understanding of probabilistic techniques
• Experience implementing tracking systems