Benchmarking Architect for Trusted ML Systems

NVIDIA; Tennessee; On-site; USD 152,000 - 241,500; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking an Evaluation/ML-Systems Engineer to own how we measure the program and to design benchmarks, baselines, and reproducible protocols that tie results to code and runs.

You will build and maintain evaluation infrastructure, partner with security researchers and platform engineers, and help the team read its own evidence with a careful, skeptical approach to metrics and claims.

Qualifications

• Bachelor's degree or equivalent with 5+ years in ML engineering or evaluation.
• Experience designing benchmarks, metrics, and sound comparisons for ML systems.
• Rigorous approach to metrics, baselines, and claims; strong debugging mindset.

Responsibilities

• Build benchmarking and reproducibility systems for ML evaluation.
• Define metrics and protocols used for measurement.
• Ensure traceability of results to code and runs.
• Maintain evidence discipline; keep findings reviewable.

Skills

ML engineering

Evaluation design

Python

Statistical analysis

Education

Bachelor's degree

Tools

Experiment tracking

Data pipelines

Job description

NVIDIA is seeking an Evaluation/ML-Systems Engineer to own how we measure the program and to design benchmarks, baselines, and reproducible protocols that tie results to code and runs.

You will build and maintain evaluation infrastructure, partner with security researchers and platform engineers, and help the team read its own evidence with a careful, skeptical approach to metrics and claims.