Senior Software Engineer - Golden Data Pipelines

Jobtailor; California (MO); On-site; USD 150,000 - 190,000; Full time

Job summary

Jobtailor seeks a senior ML evaluation engineer to own the eval flywheel strategy and architecture, shaping how road and simulation data become curated datasets and how metrics are measured against them. You will build tooling for rapid metric iteration and partner with senior engineers across test engineering, behavior planning, and infrastructure.

You will work directly with AI model developers to accelerate evaluation and ensure high-quality release processes as the system evolves.

Qualifications

• 12+ years building software, with significant time in autonomous vehicles, robotics, or large-scale ML systems.
• Deep experience evaluating ML or robotic systems: metric design, ground-truth and golden dataset curation, precision/recall methodology, and the data pipelines behind them.
• Strong Python and data engineering skills for production-scale pipelines.
• BS or MS in Computer Science, Robotics, or a related field (or equivalent experience).

Responsibilities

• Own the eval flywheel strategy and architecture.
• Set evaluation quality standards and maintain golden datasets.
• Build tooling for rapid metric iteration and reporting.
• Partner with senior engineers across test engineering, behavior planning, and infrastructure.

Skills

Machine Learning Evaluation

Golden Dataset Curation

Metric Performance Measurement

Python Programming

Data Engineering

Software Development

Robotics

Autonomous Vehicles

Large-Scale ML Systems

Ground-Truth Curation

Education

BS/MS in Computer Science or Robotics

Tools

Data Pipelines

Self-Serve Dataset Tools

Quality Reporting Tools

Job description

Jobtailor seeks a senior ML evaluation engineer to own the eval flywheel strategy and architecture, shaping how road and simulation data become curated datasets and how metrics are measured against them. You will build tooling for rapid metric iteration and partner with senior engineers across test engineering, behavior planning, and infrastructure.

You will work directly with AI model developers to accelerate evaluation and ensure high-quality release processes as the system evolves.