Senior DL Inference Engineer — GPU-Optimized LLMs (Remote)

NVIDIA Corporation; Northern (KY); Hybrid; USD 152,000 - 288,000; Full time

Job summary

NVIDIA seeks a Senior Deep Learning Software Engineer specializing in Inference to design, build, and optimize GPU-accelerated software powering today’s AI applications. You will contribute to high-performance open-source frameworks for efficient model serving and inference, enabling cutting-edge LLM and Generative AI deployments across datacenter GPUs to edge devices.

You will work with CUTLASS, OAI Triton, NCCL, and CUDA kernels while collaborating with cross-functional teams on novel

Qualifications

• Masters or PhD or equivalent experience in Computer Engineering, Computer Science, EECS, AI
• 5+ years of relevant software development experience
• Strong C/C++ programming and software design skills; Python is a plus

Responsibilities

• Performance optimization, analysis, and tuning of DL models (LLM, Multimodal, Generative AI)
• Scale performance across NVIDIA accelerators and architectures
• Contribute features and code to inference libraries and frameworks (vLLM, SGLang, FlashInfer)

Skills

C/C++ programming

Python programming

GPU programming (CUDA)

Performance optimization

Deep learning inference

Software design

Agile software development

Education

Master's degree or PhD in Computer Science/Engineering or AI

Tools

CUTLASS

OAI Triton

NCCL

CUDA kernels

Job description

NVIDIA seeks a Senior Deep Learning Software Engineer specializing in Inference to design, build, and optimize GPU-accelerated software powering today’s AI applications. You will contribute to high-performance open-source frameworks for efficient model serving and inference, enabling cutting-edge LLM and Generative AI deployments across datacenter GPUs to edge devices.

You will work with CUTLASS, OAI Triton, NCCL, and CUDA kernels while collaborating with cross-functional teams on novel