Senior Software Engineer – Evaluation Flywheel for AVs

NVIDIA; Washington (District of Columbia); On-site; USD 224,000 - 356,500; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is building the future of autonomous driving, and evaluation is how we know the drive is getting better. Our AV Evaluation team owns the metrics, golden datasets, and closed‑loop evaluation workflows that decide what ships in NVIDIA's self‑driving stack — every model change runs through us.

We are seeking a senior engineer to own the eval flywheel, the end‑to‑end engine for architecture, quality, and adoption.

Qualifications

• 12+ years building software, with significant time in autonomous vehicles, robotics, or large‑scale ML systems.
• Deep experience evaluating ML or robotic systems: metric design, ground‑truth and golden dataset curation, precision/recall methodology, and the data pipelines behind them.
• Strong Python and data engineering skills for production‑scale pipelines.

Responsibilities

• Owning the eval flywheel's strategy and architecture: how road and simulation driving data becomes curated golden datasets, how metrics are measured against them (precision/recall), and how those results earn lasting trust with the teams that depend on them.
• Setting the standard for evaluation quality: golden dataset curation, versioning, and health; metric performance measurement; and release processes that keep results dependable as the system evolves.
• Building the tooling that helps our metric developers iterate quickly: self‑serve dataset pipelines, metric performance measurement, and quality reporting used every day by the team and our partners.
• Partnering with senior engineers and leaders across test engineering, behavior planning, and infrastructure — setting expectations, working through trade‑offs, and being the voice of evaluation quality in cross‑team decisions.
• Working directly with AI model developers so evaluation iteration speed becomes an advantage for the whole program, including our push into learned, VLM‑based evaluation.

Skills

Python

Data engineering

Software architecture

Technical leadership

Communication

Autonomous vehicles

Education

BS in Computer Science / Robotics

Job description

NVIDIA is building the future of autonomous driving, and evaluation is how we know the drive is getting better. Our AV Evaluation team owns the metrics, golden datasets, and closed‑loop evaluation workflows that decide what ships in NVIDIA's self‑driving stack — every model change runs through us.

We are seeking a senior engineer to own the eval flywheel, the end‑to‑end engine for architecture, quality, and adoption.