Senior Research Engineer: Generative AI Inference

NVIDIA Corporation

Washington

On-site

USD 192,000 - 357,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

NVIDIA Corporation in the United States is seeking a Senior Research Engineer focused on Generative AI inference. You will design and evaluate routing policies for LLM traffic, build agentic benchmarks, and contribute to an open‑source repository while collaborating across NVIDIA’s accelerated serving stack.

The role requires 8+ years in DL frameworks (PyTorch or TensorFlow), experience running LLM evaluations, strong CS fundamentals, and the ability to mentor engineers in a distributed team.

Qualifications

  • 8+ years of industry experience in deep learning frameworks (PyTorch or TensorFlow).
  • Experience designing or running LLM evaluations/benchmarks and drawing sound conclusions.
  • Understanding ML, DLNs, NLP, or speech recognition.
  • Empirical research mindset with hypothesis testing and calibrations.
  • Strong communication and ability to mentor junior engineers in a distributed team.
  • A desire to grow and learn continuously.
  • Strong CS fundamentals: algorithms, data structures, parallel and distributed computing, system software.

Responsibilities

  • Design and evaluate routing policies for LLM traffic to optimize model system usage.
  • Build and run agentic benchmarks and convert results into calibration data and routing profiles.
  • Ship to open-source repo with design docs, code reviews, docs, and community contributions.
  • Collaborate with engineering teams across NVIDIA to integrate software into the NVIDIA serving stack.

Skills

DL frameworks (PyTorch/TensorFlow)
LLM evaluations/benchmarks
CS fundamentals
Empirical research mindset
Mentoring engineers
Distributed systems
Communication skills
Growth mindset

Education

Bachelor’s or Master’s degree in Computer Science

Job description

NVIDIA Corporation in the United States is seeking a Senior Research Engineer focused on Generative AI inference. You will design and evaluate routing policies for LLM traffic, build agentic benchmarks, and contribute to an open‑source repository while collaborating across NVIDIA’s accelerated serving stack.

The role requires 8+ years in DL frameworks (PyTorch or TensorFlow), experience running LLM evaluations, strong CS fundamentals, and the ability to mentor engineers in a distributed team.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Research Engineer: Generative AI Inference (Remote)
Senior Research Engineer: Generative AI Inference (Remote)

NVIDIA Corporation • Santa Clara (CA)

Remote
USD 192,000 - 356,500
Equity
Benefits
Senior Research Engineer – Generative AI Inference
Senior Research Engineer – Generative AI Inference

NVIDIA Corporation • Seattle (WA)

On-site
USD 192,000 - 356,500
Equity
Benefits
Senior Gen AI Inference Engineer (Equity Eligible)
Senior Gen AI Inference Engineer (Equity Eligible)

NVIDIA Corporation • Washington

Hybrid
USD 192,000 - 357,000
Equity
Benefits
Senior Research Engineer - Enterprise Products
Senior Research Engineer - Enterprise Products

NVIDIA Corporation • Washington

On-site
USD 192,000 - 357,000
Senior Research Engineer - Enterprise Products
Senior Research Engineer - Enterprise Products

NVIDIA Corporation • Seattle (WA)

On-site
USD 192,000 - 356,500
Equity
Benefits
Senior Generative AI Solutions Architect – Inference & MLOps
Senior Generative AI Solutions Architect – Inference & MLOps

NVIDIA Corporation • United States

Remote
USD 184,000 - 288,000
Senior DL Engineer – Inference & Model Optimization (Equity)
Senior DL Engineer – Inference & Model Optimization (Equity)

NVIDIA Corporation • United States

Remote
USD 184,000 - 356,000
Equity
Benefits
Senior GenAI Systems Engineer - Training & Inference
Senior GenAI Systems Engineer - Training & Inference

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 152,000 - 288,000
Generative AI Solutions Architect for Inference & MLOps - Equity Eligible
Generative AI Solutions Architect for Inference & MLOps - Equity Eligible

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 288,000
Equity
Benefits
Senior System Engineer - Agentic AI Inference Equity
Senior System Engineer - Agentic AI Inference Equity

NVIDIA • United States

Hybrid
USD 272,000 - 431,000
Equity
Benefits