AI Safety & ML Evaluation Systems Engineer

NVIDIA; California; On-site; USD 152,000 - 242,000; Full time

Job summary

NVIDIA is seeking an Evaluation/ML-Systems Engineer to own how we measure the program. You will design metrics, baselines, and protocols, and build infrastructure that ties results to runs and code.

You will partner with security researchers and platform engineers to ensure trustworthy experiments, and help the team learn to read its own evidence honestly. This role emphasizes reproducibility and rigorous evaluation practices in California.

Qualifications

• Bachelor's degree (or equivalent) with 5+ years in ML engineering or evaluation.
• Evaluation experience: Designing benchmarks, metrics, and statistically sound comparisons for ML systems.
• Measurement rigor: A careful, skeptical approach to metrics, baselines, and claims.
• Engineering skills: Solid Python engineering for shared infrastructure, including experiment tracking and data pipelines.

Responsibilities

• Evaluation infrastructure: Build the benchmarking and reproducibility systems we depend on.
• Metrics and protocols: Define the metrics and protocols we measure against.
• Traceability: Map every result to the code and runs that produced it.
• Evidence discipline: Keep findings reviewable and conclusions traceable.

Skills

ML engineering

Evaluation

Python

Experiment tracking

Data pipelines

Education

Bachelor's degree or equivalent

Tools

Python

Job description

NVIDIA is seeking an Evaluation/ML-Systems Engineer to own how we measure the program. You will design metrics, baselines, and protocols, and build infrastructure that ties results to runs and code.

You will partner with security researchers and platform engineers to ensure trustworthy experiments, and help the team learn to read its own evidence honestly. This role emphasizes reproducibility and rigorous evaluation practices in California.