CUDA Engineer: GPU & LLM Inference Optimization

MWDN Ltd.; Województwo mazowieckie; Remote; PLN 180,000 - 240,000; Full time

Benefits offered by this job

29 days PTO

10 recovery days

Free English classes

Contractor support

Flexible hours

HR support

Job summary

MWDN Ltd. seeks a highly technical engineer or researcher with deep expertise in GPU computing, CUDA, and LLM inference optimization to tackle AI systems challenges at the intersection of HPC and AI.

You will understand GPU underpinnings from architecture to kernels, optimize inference engines, and work with cutting-edge frameworks in an international setting. Strong analytical and hands-on skills are essential.

Qualifications

• Strong hands-on experience with CUDA and GPU programming.
• Deep understanding of GPU architecture, memory hierarchy, parallel execution, and performance optimization.
• Experience with LLM inference, AI systems, GPU kernels, or high-performance computing.
• Familiarity with one or more frameworks such as vLLM, SGLang, TensorRT-LLM, Triton, or FlashAttention.
• Experience debugging complex performance issues and investigating low-level system behavior.
• Strong problem-solving skills and the ability to communicate complex technical concepts in English.

Responsibilities

• Investigate and optimize LLM inference performance on modern GPUs.
• Work with inference frameworks such as vLLM, SGLang, TensorRT-LLM, or similar systems.
• Analyze GPU execution, memory access patterns, kernel performance, and inference bottlenecks.
• Develop, optimize, debug, or reverse-engineer CUDA kernels and low-level GPU operations.
• Explore optimization techniques for matrix multiplication, attention mechanisms, and neural network layers.
• Benchmark performance and identify opportunities to improve latency, throughput, and GPU utilization.
• Work on technically challenging problems requiring strong analytical thinking and hands-on experimentation.

Skills

CUDA programming

GPU architecture

LLM inference

English proficiency

Performance debugging

Education

PhD or equivalent in CS/ML

Tools

vLLM

TensorRT-LLM

Triton

FlashAttention

PyTorch

Job description

MWDN Ltd. seeks a highly technical engineer or researcher with deep expertise in GPU computing, CUDA, and LLM inference optimization to tackle AI systems challenges at the intersection of HPC and AI.

You will understand GPU underpinnings from architecture to kernels, optimize inference engines, and work with cutting-edge frameworks in an international setting. Strong analytical and hands-on skills are essential.