Tech Lead - Autonomy Evaluation & Real-World Testing

Atoms; San Francisco (CA); On-site; USD 185,000 - 242,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

Disability insurance

Life insurance

401(k)

Equity

Sick time

Paid holidays

Team lunch

Job summary

Atoms is building real-world robots for food, mining, and transport, and seeks a Technical Lead for Autonomy Evaluation to own the evaluation metrics and log replay platform used for every candidate release. You will scale the pipeline from on-road testing to full regression across logs, enabling reliable score-based release decisions.

The role demands leadership in metric definitions, test design, and engineering mentorship, with onsite work in San Francisco and total rewards including equity

Qualifications

• Bachelor's degree in Computer Science, Robotics, Electrical Engineering, Statistics, or related field.
• 8+ years of relevant experience.
• 2+ years as a technical lead or Engineering manager for an evaluation, validation, or test team.
• Experience with offline or system-level evaluation for autonomous vehicles or robotics.
• Experience designing safety or behavior metrics for autonomous systems.
• Hands-on experience building log replay at scale.
• Experience with GPU clusters and large-scale compute.
• Experience with evaluation dataset design and benchmarking.
• Strong understanding of sensing, perception, localization, planning, and controls.
• Proficiency in Python and ability to read C++ code.

Responsibilities

• Own safety and behavior metrics a release is judged on, including collision and near-miss measures.
• Own the pipeline that converts logs into scored test cases for perception, localization, and planning.
• Develop regression and benchmarking across the log corpus for every candidate release.
• Oversee data mining of the corpus for rare, valuable events and sampling strategies.
• Ensure deterministic and reproducible execution of evaluation at scale.
• Set practices for metric definitions, test design, and result write-ups.
• Mentor engineers joining the function and participate in hiring.

Skills

Python

C++

Autonomous systems knowledge

Statistics for validation

Leadership

Education

Bachelor's degree in Computer Science, Robotics, Electrical Engineering, Statistics

Tools

GPU clusters

Robotics middleware

Logging and replay tooling

Job description

Atoms is building real-world robots for food, mining, and transport, and seeks a Technical Lead for Autonomy Evaluation to own the evaluation metrics and log replay platform used for every candidate release. You will scale the pipeline from on-road testing to full regression across logs, enabling reliable score-based release decisions.

The role demands leadership in metric definitions, test design, and engineering mentorship, with onsite work in San Francisco and total rewards including equity