ML Evaluation & Systems Engineer — AI Safety & Security

NVIDIA; North Carolina; On-site; USD 152,000 - 242,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking an Evaluation/ML-Systems Engineer to own how we measure the program. You will design metrics, baselines, and reproducible protocols, and build infrastructure that ties results to the code and runs that produced them.

You will partner with security researchers and platform engineers to create trusted experiments, enabling rigorous evaluation and traceability as the program grows. Equity and benefits available.

Qualifications

• Bachelor's degree or equivalent in ML engineering or evaluation.
• Experience designing benchmarks, metrics, and statistically sound comparisons for ML systems.
• Strong focus on measurement rigor, baselines, and credible claims.
• Solid Python engineering for shared infrastructure, including experiment tracking and data pipelines.

Responsibilities

• Build evaluation infrastructure for benchmarking and reproducibility.
• Define the metrics and protocols used to measure progress.
• Ensure traceability by mapping results to code and runs.
• Keep findings reviewable and conclusions traceable.

Skills

ML evaluation

Benchmark design

Metrics & baselines

Python engineering

Experiment tracking

Statistical comparisons

Education

Bachelor's degree or equivalent in a relevant field

Tools

Python

Job description

NVIDIA is seeking an Evaluation/ML-Systems Engineer to own how we measure the program. You will design metrics, baselines, and reproducible protocols, and build infrastructure that ties results to the code and runs that produced them.

You will partner with security researchers and platform engineers to create trusted experiments, enabling rigorous evaluation and traceability as the program grows. Equity and benefits available.