Senior DL Inference Engineer: GPU-Accelerated AI, Equity

NVIDIA; United States; Remote; USD 184,000 - 357,000; Full time

Job summary

NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference to design, build, and optimize GPU-accelerated software powering AI applications. You will help maintain high-performance DL frameworks such as SGLang and vLLM, enabling efficient model serving and deployment across datacenters to edge devices.

Join a team focused on CPU/GPU performance, multi-architecture scaling, and implementing cutting-edge algorithms for public release.

Qualifications

• Masters or PhD or equivalent in Computer Engineering, CS, EECS, or AI.
• 6+ years of relevant software development experience.
• Excellent C/C++ programming and software design skills.
• SW Agile skills are helpful and Python experience is a plus.
• Experience with training, deploying or optimizing DL inference is a plus.
• Background in performance modeling, profiling, debugging, or GPU/CPU architecture is a plus.

Responsibilities

• Performance optimization and tuning of DL models for inference.
• Scale model inference across architectures and NVIDIA accelerators.
• Contribute features to vLLM, SGLang, FlashInfer and related LLM software.
• Collaborate with cross-functional teams across frameworks and NVIDIA libraries.

Skills

C/C++ programming

Python

Software design

Agile

6+ years experience

Education

Masters or PhD or equivalent

Tools

CUDA

NCCL

CUTLASS

vLLM

SGLang

OAI Triton

Job description

NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference to design, build, and optimize GPU-accelerated software powering AI applications. You will help maintain high-performance DL frameworks such as SGLang and vLLM, enabling efficient model serving and deployment across datacenters to edge devices.

Join a team focused on CPU/GPU performance, multi-architecture scaling, and implementing cutting-edge algorithms for public release.