ML Evaluation & Benchmark Engineer for AI Safety

NVIDIA; Santa Clara (CA); On-site; USD 152,000 - 242,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking an Evaluation/ML-Systems Engineer to own how we measure the program. You will design metrics, baselines, and reproducible protocols, and build infrastructure tying results to code and runs.

You will work with security researchers and platform engineers to ensure trustworthy experiments and transparent evaluations, with an emphasis on traceability and rigorous evidence in every conclusion.

Qualifications

• Bachelor's degree (or equivalent) with 5+ years in ML engineering or evaluation.
• Evaluation experience: Designing benchmarks, metrics, and statistically sound comparisons for ML systems.
• Measurement rigor: A careful, skeptical approach to metrics, baselines, and claims.
• Engineering skills: Solid Python engineering for shared infrastructure, including experiment tracking and data pipelines.

Responsibilities

• Build evaluation infrastructure: benchmarking and reproducibility systems.
• Define metrics and protocols we measure against.
• Map every result to the code and runs that produced it.
• Keep findings reviewable and conclusions traceable.

Skills

Python

ML engineering

Evaluation

Experiment tracking

Data pipelines

Education

Bachelor's degree or equivalent

Job description

NVIDIA is seeking an Evaluation/ML-Systems Engineer to own how we measure the program. You will design metrics, baselines, and reproducible protocols, and build infrastructure tying results to code and runs.

You will work with security researchers and platform engineers to ensure trustworthy experiments and transparent evaluations, with an emphasis on traceability and rigorous evidence in every conclusion.