Senior Deep Learning Algorithm Engineer

NVIDIA Corporation; Santa Clara (CA); Hybrid; USD 184,000 - 288,000; Full time

Benefits offered by this job

Equity

Competitive benefits

Job summary

NVIDIA is seeking a Senior Deep Learning Algorithms Engineer to advance Dynamo, our open-source distributed inference platform for large-scale, low-latency AI services. You’ll lead architecture and performance work across Dynamo and open source frameworks.

You’ll collaborate across research, software, systems, and hardware teams to make AI inference faster, more efficient, and easier to deploy. You’ll engage with the broader ecosystem, including vLLM, SGLang, and TensorRT-LLM as well as with

Qualifications

• BS, MS, or PhD in Computer Science, Electrical Engineering, Computer Engineering, or related field (or equivalent experience).
• 3+ years building, profiling, and debugging performance-critical distributed or ML systems.
• Strong programming skills in Python and/or Rust, C++.
• Understanding of modern ML architectures and inference techniques.

Responsibilities

• Design, build, and maintain Dynamo integrations for open source frameworks vLLM, SGLang, TRTLLM.
• Partner with open source communities to land measurable gains in latency, throughput, reliability, and efficiency.
• Showcase NVIDIA token/watt leadership by pushing the pareto frontier on public/private benchmarks.
• Find and remove bottlenecks across runtimes, kernels, networking, routing, and orchestration.
• Develop inference optimizations for scheduling, disaggregation, KV caching, and autoscaling.

Skills

Python

Rust

C++

Distributed systems

ML frameworks

Education

BS/MS/PhD in CS/EE/CE or related field

Job description

NVIDIA is seeking a Senior Deep Learning Algorithms Engineer to advance Dynamo, our open-source distributed inference platform for large-scale, low-latency AI services. You’ll lead architecture and performance work across Dynamo and open source frameworks. You’ll collaborate across research, software, systems, and hardware teams to make AI inference faster, more efficient, and easier to deploy. You’ll engage with the broader ecosystem, including vLLM, SGLang, and TensorRT-LLM as well as with external partners to build the best operating system for AI.

What you'll be doing:

• Design, build, and maintain Dynamo integrations for open source frameworks vLLM, SGLang, TRTLLM.
• Partner with open source communities to land measurable gains in latency, throughput, reliability, and efficiency.
• Showcase NVIDIA token/watt leadership by pushing the pareto frontier on public/private benchmarks.
• Find and remove bottlenecks across runtimes, kernels, networking, routing, and orchestration.
• Develop inference optimizations for scheduling, disaggregation, KV caching, and autoscaling.

What we need to see:

• BS, MS, PhD in Computer Science, Electrical Engineering, Computer Engineering, or a related field (or equivalent experience).
• 3+ years building, profiling, and debugging performance-critical distributed or ML systems.
• Strong programming skills in Python and/or Rust, C++.
• Understanding of modern ML architectures and inference techniques.

Ways to stand out from the crowd:

• High agency and a track record of leading ambiguous work end to end.
• Experience with AI Accelerators
• Open-source contributions / leadership
• Research in ML inference or distributed systems.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. #LI-Hybrid

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4. You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until August 9, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

NVIDIA pioneered accelerated computing. Today, our AI infrastructure powers global intelligence, transforming every industry. Learn more about NVIDIA.