Senior DL Inference Engineer — GPU Performance OpenSource

NVIDIA; California (MO); On-site; USD 152,000 - 287,500; Full time

Benefits offered by this job

Equity

Benefits package

Competitive salary

Job summary

NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference to design, build, and optimize GPU-accelerated software powering today’s AI applications. You will contribute to high-performance open-source frameworks and implement state‑of‑the‑art inference across NVIDIA accelerators, from data centers to edge devices.

This role involves optimizing DL models, collaborating with cross‑functional teams, and delivering scalable, production‑ready solutions with equity and

Qualifications

• Masters or PhD or equivalent experience in Computer Engineering, Computer Science, EECS, AI (5+ years).
• Excellent C/C++ programming and software design skills; Python experience a plus.
• Prior experience with training, deploying or optimizing the inference of DL models in production is a plus.

Responsibilities

• Performance optimization, analysis, and tuning of DL models for LLMs, Multimodal, and Generative AI.
• Scale DL model performance across architectures and NVIDIA accelerators.
• Contribute features to NVIDIA’s inference libraries (vLLM, SGLang, FlashInfer) and other LLM software.
• Collaborate with cross-functional teams across frameworks and NVIDIA libraries to optimize inference.

Skills

C/C++ programming

Python

CUDA

Open-source frameworks

Education

Masters or PhD in Computer Science/Engineering/AI

Tools

CUTLASS

OAI Triton

NCCL

CUDA kernels

Job description

NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference to design, build, and optimize GPU-accelerated software powering today’s AI applications. You will contribute to high-performance open-source frameworks and implement state‑of‑the‑art inference across NVIDIA accelerators, from data centers to edge devices.

This role involves optimizing DL models, collaborating with cross‑functional teams, and delivering scalable, production‑ready solutions with equity and