Senior DL Inference Engineer - GPU & LLM Performance

NVIDIA Corporation; Santa Clara (CA); Vor Ort; USD 184.000 - 357.000; Vollzeit

Benefits dieser Stelle

Equity

Benefits

Zusammenfassung

NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference to design, build, and optimize GPU-accelerated software powering AI applications. You will help develop high-performance DL frameworks including SGLang and vLLM for efficient model serving and inference.

You will work on improving platforms, enabling smooth deployment and serving of leading language models, and implementing cutting-edge algorithms for public release.

Qualifikationen

• Master's or PhD (or equiv) in Computer Engineering, CS, EECS or AI.
• 6+ years of software development experience.
• Strong C/C++ programming and software design skills.
• Python experience is a plus; Agile methods helpful.

Aufgaben

• Performance optimization and tuning of DL models across domains (LLM, Multimodal, Generative AI).
• Scale DL models across architectures and NVIDIA accelerators.
• Contribute features to inference libraries like vLLM, SGLang, FlashInfer and other solutions.
• Collaborate with cross‑functional teams across frameworks and NVIDIA libraries.

Kenntnisse

C/C++ programming

Software design

Python experience

SW Agile

Ausbildung

Master's or PhD in Computer Science/Engineering/AI

Tools

CUTLASS

NCCL

CUDA

OAI Triton

SGLang

vLLM

Jobbeschreibung

NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference to design, build, and optimize GPU-accelerated software powering AI applications. You will help develop high-performance DL frameworks including SGLang and vLLM for efficient model serving and inference.

You will work on improving platforms, enabling smooth deployment and serving of leading language models, and implementing cutting-edge algorithms for public release.