Senior Research Engineer - Enterprise Products

NVIDIA Corporation

Washington

On-site

USD 192,000 - 357,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

NVIDIA Corporation in the United States is seeking a Senior Research Engineer focused on Generative AI inference. You will design and evaluate routing policies for LLM traffic, build agentic benchmarks, and contribute to an open‑source repository while collaborating across NVIDIA’s accelerated serving stack.

The role requires 8+ years in DL frameworks (PyTorch or TensorFlow), experience running LLM evaluations, strong CS fundamentals, and the ability to mentor engineers in a distributed team.

Qualifications

  • 8+ years of industry experience in deep learning frameworks (PyTorch or TensorFlow).
  • Experience designing or running LLM evaluations/benchmarks and drawing sound conclusions.
  • Understanding ML, DLNs, NLP, or speech recognition.
  • Empirical research mindset with hypothesis testing and calibrations.
  • Strong communication and ability to mentor junior engineers in a distributed team.
  • A desire to grow and learn continuously.
  • Strong CS fundamentals: algorithms, data structures, parallel and distributed computing, system software.

Responsibilities

  • Design and evaluate routing policies for LLM traffic to optimize model system usage.
  • Build and run agentic benchmarks and convert results into calibration data and routing profiles.
  • Ship to open-source repo with design docs, code reviews, docs, and community contributions.
  • Collaborate with engineering teams across NVIDIA to integrate software into the NVIDIA serving stack.

Skills

DL frameworks (PyTorch/TensorFlow)
LLM evaluations/benchmarks
CS fundamentals
Empirical research mindset
Mentoring engineers
Distributed systems
Communication skills
Growth mindset

Education

Bachelor’s or Master’s degree in Computer Science

Job description

We are now looking for a Senior Research Engineer passionate about Generative AI inference. Are you excited to change the way people infuse AI into products and services? NVIDIA is at the forefront of generative AI models, from language to images. NVIDIA provides building blocks to democratize AI and make generative AI easy to develop, integrate, and deploy. Our team is dedicated to developing optimized inferencing technologies to support our growing generative AI needs. We contribute to all steps of the machine learning lifecycle: from conceptualization, to applied research, engineering for optimized inference, and deployment. Collaborate with research teams, engineers, and open-source community.

What you will be doing:
  • Design and evaluate routing policies for LLM traffic to best use mixture of model systems.
  • Build and run agentic benchmarks (e.g., Terminal-Bench ) to measure algorithm quality, and turn results into calibration data and routing profiles
  • Ship to an open-source repo: design docs, code review, docs, and community contributions
  • Collaborating with engineering teams across all of NVIDIA to ensure our software integrates seamlessly up and down the NVIDIA accelerated serving stack.
What we need to see:
  • Bachelor's of Master's degree in Computer Science or equivalent experience.
  • 8+ years of industry experience in Deep Learning frameworks (PyTorch or TensorFlow).
  • Experience designing or running LLM evaluations/benchmarks — ideally agentic ones — and drawing statistically sound conclusions from them
  • Understanding of modern techniques in Machine Learning, Deep Neural Networks, Natural Language Processing, or Speech Recognition.
  • Empirical research mindset: forming hypotheses about new algorithms, running calibrations, iterating on results
  • Strong communication and interpersonal skills, along with the ability to work in a dynamic and distributed team. A history of mentoring junior engineers and interns is a huge plus.
  • A desire to constantly grow and learn new things.
  • Strong computer science fundamentals - algorithms and data structures, computational complexity, parallel and distributed computing, system software.
Ways to stand out from a crowd:
  • Experience architecting or developing large-scale distributed systems for deep learning.
  • Agentic benchmark creation and publications.
  • Knowledge of CPU and/or GPU architecture.
  • GPU programming (CUDA).

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are: 192,000 USD – 304,750 USD for Level 4; and 224,000 USD – 356,500 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 3, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Research Engineer - Enterprise Products
Senior Research Engineer - Enterprise Products

NVIDIA Corporation • Seattle (WA)

On-site
USD 192,000 - 356,500
Equity
Benefits
Senior Research Engineer - Enterprise Products
Senior Research Engineer - Enterprise Products

NVIDIA Corporation • Santa Clara (CA)

Remote
USD 192,000 - 356,500
Equity
Benefits
Senior System Software Engineer, Agentic Inference - Dynamo
Senior System Software Engineer, Agentic Inference - Dynamo

NVIDIA • United States

Hybrid
USD 272,000 - 431,000
Equity
Benefits
Engineering Manager, Deep Learning Inference
Engineering Manager, Deep Learning Inference

NVIDIA Corporation • United States

Hybrid
USD 184,000 - 357,000
Equity
Benefits
Senior Systems Software Engineer - Machine Learning
Senior Systems Software Engineer - Machine Learning

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 288,000
Senior Systems Software Engineer - Machine Learning
Senior Systems Software Engineer - Machine Learning

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 152,000 - 288,000
Engineering Manager, Deep Learning Inference
Engineering Manager, Deep Learning Inference

NVIDIA Corporation • Washington

On-site
USD 184,000 - 357,000
Equity
Benefits package
Developer Relations Manager, Higher Education and Research - Foundational AI
Developer Relations Manager, Higher Education and Research - Foundational AI

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 288,000
Equity
Benefits
Developer Relations Manager, Higher Education and Research - Foundational AI
Developer Relations Manager, Higher Education and Research - Foundational AI

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 180,000 - 270,000
Equity
Benefits
Senior Research Scientist for Generative AI
Senior Research Scientist for Generative AI

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 192,000 - 357,000
Equity
Benefits