Senior Software Engineer - AI Agent Harness & Evaluation

NVIDIA Corporation; California (MO); Hybrid; USD 184,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits package

Job summary

NVIDIA is seeking a Senior Software Engineer to help build core libraries, evaluation systems, and reusable harness capabilities for safer, faster agent development. You will work across open‑source agent harnesses, sandboxed execution, model-provider infrastructure, and agent benchmarks to improve the next generation of autonomous software.

Join a collaborative team focused on scalable evaluation, reproducible experiments, and upstream contributions, with emphasis on reliability, latency, and

Qualifications

• Bachelor’s or Master’s in CS/AI/Applied Math or related field.
• 8+ years of hands-on software‑engineering experience with production systems ownership.
• Expert Python with proficiency in Rust, Go, C++, or TypeScript.
• Experience building or extending LLM agents, tooling, or evaluation infrastructure.
• Strong understanding of asynchronous execution, containers, sandboxing, networking.
• Experience crafting reproducible experiments and reliability analysis.
• Shipping open‑source or developer‑facing software with tests and docs.

Responsibilities

• Define and evolve the evaluation approach for open agent harnesses across frameworks, models, and benchmarks.
• Build scalable, reproducible evaluation systems spanning CI, sandboxed execution, trace capture, and analysis.
• Diagnose agent failures from traces, logs, tool results, and benchmark artifacts.
• Design controlled experiments and promotion criteria distinguishing genuine harness improvements.
• Ship harness and runtime improvements, including upstream open‑source contributions and maintainable docs.
• Partner with Relay, Hermes, model, infrastructure, and research teams to turn recurring needs into reusable capabilities.

Skills

Python

Rust

Go

C++

TypeScript

LLM Agents

Agent Evaluation

Education

Bachelor’s or Master’s in CS/AI/Applied Math

Job description

NVIDIA is seeking a Senior Software Engineer to help build core libraries, evaluation systems, and reusable harness capabilities for safer, faster agent development. You will work across open‑source agent harnesses, sandboxed execution, model-provider infrastructure, and agent benchmarks to improve the next generation of autonomous software.

Join a collaborative team focused on scalable evaluation, reproducible experiments, and upstream contributions, with emphasis on reliability, latency, and