Senior Deep Learning Inference Engineer - Equity Eligible

NVIDIA Gruppe; Santa Clara (CA); On-site; USD 224,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. You will design, build, and optimize GPU-accelerated software powering today’s AI applications, working on high-performance DL frameworks like SGLang and vLLM.

You’ll implement latest algorithms, optimize model serving across datacenter GPUs to edge SoCs, and contribute to open-source tools (CUDA kernels, CUTLASS, NCCL) to accelerate inference pipelines.

Qualifications

• Masters or PhD (or equivalent) in Computer Engineering, Computer Science, EECS, or AI.
• 6+ years of software development experience.
• Excellent C/C++ programming and software design skills; Python is a plus.
• Experience with training, deploying or optimizing DL model inference in production is a plus.

Responsibilities

• Performance optimization, analysis, and tuning of DL models across domains (LLM, Multimodal, Generative AI).
• Scale performance of DL models across NVIDIA accelerators and architectures.
• Contribute features and code to NVIDIA’s inference libraries (vLLm, SGLang) and related tools.

Skills

C/C++ programming

Python experience

SW Agile

Performance optimization

Education

Masters or PhD in Computer Science/Engineering/AI

Tools

CUDA kernels

CUTLASS

NCCL

OAI Triton

SGLang

vLLM

Job description

NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. You will design, build, and optimize GPU-accelerated software powering today’s AI applications, working on high-performance DL frameworks like SGLang and vLLM.

You’ll implement latest algorithms, optimize model serving across datacenter GPUs to edge SoCs, and contribute to open-source tools (CUDA kernels, CUTLASS, NCCL) to accelerate inference pipelines.