Part-Time AI Validation & Benchmarking Engineer

Zoox; Foster City (CA); In loco; USD 34.000 - 49.000; Part-time

Descrizione del lavoro

Zoox is seeking a Part-Time Student Worker to support the end-to-end validation pipeline for AI tools, including maintaining test datasets, running benchmarks, and measuring agent accuracy across routing decisions and outputs. This is an on-site CA role.

You must be enrolled in a BS/MS in CS, Data Science, or Engineering, commit to 20+ hours per week for at least 3 months, and work on-site at a Zoox office. Compensation is $30/hour; vendor terms apply.

Competenze

• Currently enrolled in a B.S. or M.S. in Computer Science, Data Science, Engineering or a related field.
• Available to commit to a minimum three-month assignment.
• Able to commit to a minimum of 20 hours per week.
• Able to work on-site at Zoox office.

Mansioni

• Run and maintain the benchmark pipeline, analyzing results to identify routing errors and regressions across agent variants.
• Build and expand ground truth datasets used to evaluate agent outputs against known-correct answers.
• Identify and address gaps in benchmark validation and support building a more comprehensive evaluation infrastructure to improve validation prior to release.
• Develop new evaluation dimensions such as label accuracy and structured output correctness beyond the existing team classification benchmarks.
• Investigate failure modes in agent outputs and work with engineers to surface actionable improvements.
• Write scripts and tooling to automate data collection, result parsing, and metric reporting.
• Document findings, track benchmark trends over time, and present results to the team.

Conoscenze

Python

Evaluation concepts

Structured data

Formazione

BS/MS in Computer Science or related field

Strumenti

Cursor

Claude

Descrizione del lavoro

Zoox is seeking a Part-Time Student Worker to support the end-to-end validation pipeline for AI tools, including maintaining test datasets, running benchmarks, and measuring agent accuracy across routing decisions and outputs. This is an on-site CA role.

You must be enrolled in a BS/MS in CS, Data Science, or Engineering, commit to 20+ hours per week for at least 3 months, and work on-site at a Zoox office. Compensation is $30/hour; vendor terms apply.