Senior DL Inference Engineer - GPU & LLM Performance

NVIDIA Corporation; Santa Clara (CA); On-site; USD 184,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference to design, build, and optimize GPU-accelerated software powering AI applications. You will help develop high-performance DL frameworks including SGLang and vLLM for efficient model serving and inference.

You will work on improving platforms, enabling smooth deployment and serving of leading language models, and implementing cutting-edge algorithms for public release.

Qualifications

• Master's or PhD (or equiv) in Computer Engineering, CS, EECS or AI.
• 6+ years of software development experience.
• Strong C/C++ programming and software design skills.
• Python experience is a plus; Agile methods helpful.

Responsibilities

• Performance optimization and tuning of DL models across domains (LLM, Multimodal, Generative AI).
• Scale DL models across architectures and NVIDIA accelerators.
• Contribute features to inference libraries like vLLM, SGLang, FlashInfer and other solutions.
• Collaborate with cross‑functional teams across frameworks and NVIDIA libraries.

Skills

C/C++ programming

Software design

Python experience

SW Agile

Education

Master's or PhD in Computer Science/Engineering/AI

Tools

CUTLASS

NCCL

CUDA

OAI Triton

SGLang

vLLM

Job description

NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference to design, build, and optimize GPU-accelerated software powering AI applications. You will help develop high-performance DL frameworks including SGLang and vLLM for efficient model serving and inference.

You will work on improving platforms, enabling smooth deployment and serving of leading language models, and implementing cutting-edge algorithms for public release.