Senior DL Inference Engineer — GPU-Accelerated AI

NVIDIA; California; Hybrid; USD 152,000 - 288,000; Full time

Benefits offered by this job

Equity

Benefits

Hybrid work model

Job summary

NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference to design, build, and optimize GPU-accelerated software powering AI applications. The role focuses on high-performance open-source frameworks and scalable model serving across datacenter to edge.

You will optimize inference pipelines and contribute to vLLM, SGLang, and related tools. Collaborating with teams across NVIDIA libraries and frameworks, you will push performance for state-of-the-art LLMs and Generative AI

Qualifications

• Masters or PhD (or equivalent) in Computer Science, Computer Engineering, EECS or AI.
• 5+ years of software development experience.
• Strong C/C++ programming and software design skills; Python is a plus.

Responsibilities

• Optimize and tune DL models for inference across architectures and NVIDIA accelerators.
• Contribute features to inference libraries like vLLM, SGLang, FlashInfer.
• Collaborate with cross-functional teams to advance model serving and deployment pipelines.
• Work with open-source DL tools and frameworks to push performance boundaries.

Skills

C/C++ programming

Python

CUDA programming

Performance optimization

NVIDIA software frameworks

Education

Master's or PhD or equivalent

Tools

OAI Triton

CUTLASS

NCCL

vLLM

SGLang

Job description

NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference to design, build, and optimize GPU-accelerated software powering AI applications. The role focuses on high-performance open-source frameworks and scalable model serving across datacenter to edge.

You will optimize inference pipelines and contribute to vLLM, SGLang, and related tools. Collaborating with teams across NVIDIA libraries and frameworks, you will push performance for state-of-the-art LLMs and Generative AI