Senior DL Inference Engineer - GPU-Accelerated AI

NVIDIA; Amsterdam; On-site; EUR 120,000 - 180,000; Full time

Job summary

NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our Amsterdam team. You will help design, build, and optimize GPU-accelerated software powering AI applications, focusing on high-performance DL frameworks including SGLang and vLLM, enabling efficient model serving.

You will work with open-source tools like CUTLASS, OAI Triton, NCCL, and CUDA kernels to implement and optimize inference pipelines, and you will contribute to features in NVIDIA's inference

Qualifications

• Master's or PhD in Computer Engineering, Computer Science, EECS, or AI.
• 5+ years of software development experience.
• Strong C/C++ programming and software design skills; Python is a plus.

Responsibilities

• Performance optimization, analysis, and tuning of DL models and inference.
• Contribute features to SGLang, vLLM and other DL frameworks.
• Collaborate with cross‑functional teams to drive performance improvements.

Skills

C/C++ programming

Software design

Python experience

Agile methodologies

Education

Master's or PhD in Computer Engineering, Computer Science, EECS, or AI

Tools

CUTLASS

NCCL

CUDA kernels

OAI Triton

vLLM

SGLang

Job description

NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our Amsterdam team. You will help design, build, and optimize GPU-accelerated software powering AI applications, focusing on high-performance DL frameworks including SGLang and vLLM, enabling efficient model serving.

You will work with open-source tools like CUTLASS, OAI Triton, NCCL, and CUDA kernels to implement and optimize inference pipelines, and you will contribute to features in NVIDIA's inference