ML Evaluation & Benchmarking Systems Engineer

NVIDIA; New York (NY); On-site; USD 152,000 - 241,500; Full time

Job summary

NVIDIA in New York is seeking an Evaluation/ML-Systems Engineer to own how we measure the program, design benchmarks, baselines, and reproducible results. You will separate real capability from anecdote and make our numbers meaningful as the program grows, with benchmarks that define progress.

You will collaborate with security researchers and platform engineers to design trusted experiments, map every result to the code and runs that produced it, and automate the boring parts of measurement so

Qualifications

• Bachelor's degree (or equivalent) with 5+ years in ML engineering or evaluation.
• Evaluation experience: Designing benchmarks, metrics, and sound comparisons.
• Measurement rigor: A careful, skeptical approach to metrics and baselines.
• Engineering skills: Solid Python for shared infrastructure and data pipelines.

Responsibilities

• Evaluation infrastructure: Build the benchmarking and reproducibility systems.
• Metrics and protocols: Define the metrics and protocols we measure against.
• Traceability: Map every result to the code and runs that produced it.
• Evidence discipline: Keep findings reviewable and conclusions traceable.

Skills

ML engineering

Evaluation

Python programming

Experiment tracking

Education

Bachelor's degree or equivalent experience

Job description

NVIDIA in New York is seeking an Evaluation/ML-Systems Engineer to own how we measure the program, design benchmarks, baselines, and reproducible results. You will separate real capability from anecdote and make our numbers meaningful as the program grows, with benchmarks that define progress.

You will collaborate with security researchers and platform engineers to design trusted experiments, map every result to the code and runs that produced it, and automate the boring parts of measurement so