Senior AI Safety & Evaluation Engineer

NVIDIA Corporation

United States

Remote

USD 184,000 - 357,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Benefits

Job summary

NVIDIA Corporation is seeking a Machine Learning Engineer / AI Researcher / Data Scientist to join its AI Safety and Responsibility efforts within Enterprise Risk Management. You will design safety benchmarks, develop evaluation pipelines, and translate risk scenarios into actionable tests for multimodal models.

You will collaborate with researchers and platform engineers to build reusable tooling, conduct failure analysis, and communicate findings with reproducible results that inform technical

Qualifications

  • Education and Experience: Bachelor’s degree or equivalent experience, with 6+ years in the field of machine learning engineering or evaluation.
  • Evaluation Design: Experience developing benchmarks, metrics, and statistically sound comparisons for ML systems, including selecting baselines and interpreting uncertainty.
  • Ability to translate ambiguous evaluation questions into testable experiments.
  • Engineering: Strong Python skills and experience building maintainable shared tools, data pipelines, and experiment-tracking workflows.
  • Analytical Rigor: Ability to assess dataset quality, identify limitations in metrics and scoring methods, and support conclusions with reproducible evidence.
  • Communication: Clearly explain findings and tradeoffs to researchers, engineering partners, and executives.

Responsibilities

  • Safety Benchmarking: Design and maintain safety benchmarks for large language and multimodal models, translating risk scenarios into test cases, datasets, and scoring rubrics.
  • Evaluation Methodology: Define metrics and protocols that assess safety alongside model usefulness, using baselines, uncertainty estimates, and failure analysis to distinguish meaningful improvements from noise.
  • Reproducible Evaluation: Build reusable Python pipelines with versioned datasets, model configurations, and experiment tracking to reproduce results and compare performance across model releases.
  • Automated Red-Teaming: Develop tools to discover failure modes and expand evaluation coverage, incorporating human review to validate automated scoring and provide additional judgement.
  • Failure Analysis: Investigate model failures with researchers, document actionable findings, and develop regression tests to assess whether model changes resolve identified issues.
  • Results and Communication: Partner with platform engineers to store and aggregate evaluation results, and clearly communicate findings, limitations, and emerging risks to researchers and decision-makers.

Skills

Statistical reasoning
Communication
Ambiguity to testable experiments

Education

Bachelor’s degree or equivalent experience, with 6+ years in ML engineering/evaluation
Education and Experience

Tools

Python
Experiment tracking

Job description

NVIDIA Corporation is seeking a Machine Learning Engineer / AI Researcher / Data Scientist to join its AI Safety and Responsibility efforts within Enterprise Risk Management. You will design safety benchmarks, develop evaluation pipelines, and translate risk scenarios into actionable tests for multimodal models.

You will collaborate with researchers and platform engineers to build reusable tooling, conduct failure analysis, and communicate findings with reproducible results that inform technical

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Safety Evaluations Engineer – Benchmarks & Reproducibility
AI Safety Evaluations Engineer – Benchmarks & Reproducibility

Nvidia Corporation • Santa Clara (CA)

On-site
USD 184,000 - 288,000
Equity
Benefits
Senior ML Safety Evaluator & Benchmark Architect (Equity)
Senior ML Safety Evaluator & Benchmark Architect (Equity)

NVIDIA Corporation • California

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior AI Safety Engineer – LLM Security & Alignment
Senior AI Safety Engineer – LLM Security & Alignment

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 200,000 - 288,000
Equity
Benefits
Senior AI Safety Engineer - Equity & Agentic Automation
Senior AI Safety Engineer - Equity & Agentic Automation

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Benefits package
Competitive salary
Senior Machine Learning Engineer, AI Safety Evaluations
Senior Machine Learning Engineer, AI Safety Evaluations

Nvidia Corporation • Santa Clara (CA)

On-site
USD 184,000 - 288,000
Equity
Benefits
Senior Machine Learning Engineer, AI Safety Evaluations
Senior Machine Learning Engineer, AI Safety Evaluations

NVIDIA Corporation • United States

Remote
USD 184,000 - 357,000
Equity
Benefits
Senior Machine Learning Engineer, AI Safety Evaluations
Senior Machine Learning Engineer, AI Safety Evaluations

NVIDIA Corporation • California

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior AI Safety Engineer - Guardrails & Equity
Senior AI Safety Engineer - Guardrails & Equity

NVIDIA Corporation • United States

Remote
USD 184,000 - 357,000
Senior AI Safety Engineer — Agentic Automation & Safe Models
Senior AI Safety Engineer — Agentic Automation & Safe Models

Nvidia Corporation in • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Senior AI Safety Scientist: Multimodal Deep Learning
Senior AI Safety Scientist: Multimodal Deep Learning

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 351,000
Equity