ML Evaluation & Benchmarking Engineer

Nvidia Corporation; Santa Clara (CA); On-site; USD 152,000 - 241,500; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking an Evaluation/ML-Systems Engineer to own how we measure the program and ensure reproducible results across runs and code. You will design benchmarks, baselines, and protocols while building infrastructure that ties each result to its proving run.

You will partner with security researchers and platform engineers to design trustworthy experiments, enabling clear, reviewable conclusions. Equity and benefits accompany a competitive base salary.

Qualifications

• Bachelor’s degree (or equivalent experience) with 5+ years in ML engineering or evaluation.
• Evaluation experience: Designing benchmarks, metrics, and statistically sound comparisons for ML systems.
• Measurement rigor: A careful, skeptical approach to metrics, baselines, and claims.
• Engineering skills: Solid Python engineering for shared infrastructure, including experiment tracking and data pipelines.

Responsibilities

• Evaluation infrastructure: Build the benchmarking and reproducibility systems we depend on.
• Metrics and protocols: Define the metrics and protocols we measure against.
• Traceability: Map every result to the code and runs that produced it.
• Evidence discipline: Keep findings reviewable and conclusions traceable.

Skills

ML engineering

Evaluation

Python

Experiment tracking

Data pipelines

Education

Bachelor's degree

Job description

NVIDIA is seeking an Evaluation/ML-Systems Engineer to own how we measure the program and ensure reproducible results across runs and code. You will design benchmarks, baselines, and protocols while building infrastructure that ties each result to its proving run.

You will partner with security researchers and platform engineers to design trustworthy experiments, enabling clear, reviewable conclusions. Equity and benefits accompany a competitive base salary.