Senior Deep Learning Inference Engineer - GPU Optimized

NVIDIA; Poland; On-site; PLN 221,000 - 384,000; Full time

Job summary

NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. You will design, build, and optimize GPU-accelerated software powering today’s most sophisticated AI applications.

You’ll work on high-performance frameworks including SGLang and vLLM, driving optimization for state-of-the-art LLMs across NVIDIA accelerators. Collaboration across teams will accelerate production deployment of AI models.

Qualifications

• Master’s/PhD or equivalent experience in Computer Engineering, Computer Science, EECS or AI.
• 5+ years of relevant software development experience.
• Excellent C/C++ programming and software design skills; Python experience is a plus.
• Experience with training, deploying or optimizing DL inference in production.

Responsibilities

• Performance optimization, analysis, and tuning of DL models across domains like LLM and Generative AI.
• Scale DL model performance across NVIDIA accelerators and architectures.
• Contribute features and code to NVIDIA inference libraries, e.g., vLLM and SGLang, plus related tools.
• Collaborate with cross-functional teams to implement and optimize model serving pipelines.

Skills

C/C++ programming

Python

Software design

Agile

Profiling

Performance optimization

Education

Master's or PhD in Computer Engineering/CS/EECS/AI

Tools

CUTLASS

OAI Triton

NCCL

CUDA kernels

vLLM

SGLang

PyTorch

Triton

Job description

NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. You will design, build, and optimize GPU-accelerated software powering today’s most sophisticated AI applications.

You’ll work on high-performance frameworks including SGLang and vLLM, driving optimization for state-of-the-art LLMs across NVIDIA accelerators. Collaboration across teams will accelerate production deployment of AI models.