Senior DL Inference Engineer — GPU-Accelerated AI, Equity

NVIDIA Gruppe; California (MO); On-site; USD 152,000 - 288,000; Full time

Job summary

NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. You will help design, build, and optimize GPU-accelerated software powering today’s AI applications, including high‑performance open-source frameworks for fast model serving and inference.

You will collaborate with the deep learning community to implement the latest algorithms for public release in inference frameworks, focusing on state‑of‑the‑art LLMs and Generative AI models across datacenter

Qualifications

• Masters or PhD or equivalent experience in Computer Engineering, Computer Science, EECS, AI.
• 5+ years of relevant software development experience.
• Excellent C/C++ programming and software design skills; Python is a plus.

Responsibilities

• Performance optimization, analysis, and tuning of DL models in DL domains (LLM, Multimodal, Generative AI).
• Scale DL model performance across NVIDIA accelerators and architectures.
• Contribute features and code to NVIDIA’s inference libraries and related tools.
• Collaborate with cross-functional teams across frameworks and libraries to optimize inference pipelines.

Skills

C/C++ programming

Python

Performance optimization

GPU programming

Education

Masters/PhD in Computer Science/Engineering/AI

Tools

NCCL

CUTLASS

OAI Triton

vLLM

SGLang

CUDA kernels

Job description

NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. You will help design, build, and optimize GPU-accelerated software powering today’s AI applications, including high‑performance open-source frameworks for fast model serving and inference.

You will collaborate with the deep learning community to implement the latest algorithms for public release in inference frameworks, focusing on state‑of‑the‑art LLMs and Generative AI models across datacenter