Senior LLM Inference Engineer — GPU Performance & Scale

Empiric; Amstelveen; On-site; EUR 90,000 - 130,000; Full time

Job summary

Empiric seeks a Senior AI Inference Engineer to lead production LLM inference on GPU infrastructure and secure enterprise deployments. You will optimise GPU-based AI workloads, benchmark model performance, and help scale high-performance inference across multi-GPU setups.

You will design and implement efficient serving frameworks, quantisation strategies, and routing for enterprise environments. Strong collaboration with engineering teams is essential to deliver reliable, scalable AI solutions.

Qualifications

• Strong hands-on experience developing and operating enterprise AI/ML platforms.
• Production experience deploying and optimising LLM inference on GPUs, ideally with vLLM.
• Deep understanding of inference optimisation, KV cache, batching, quantisation and GPU memory management.
• Experience benchmarking LLM performance, including throughput, time-to-first-token and concurrency.
• Working knowledge of Kubernetes and containerised AI workloads.
• Experience documenting technical design decisions and performance findings.
• Comfortable presenting technical findings to engineering teams and stakeholders.

Responsibilities

• Design production LLM inference workloads and optimise for performance.
• Benchmark AI model performance on GPU infrastructure and multi-GPU configs.
• Improve throughput, latency, concurrency and GPU utilisation.
• Evaluate tensor partitioning, KV caching, batching, and intelligent routing.
• Develop benchmarking frameworks for model quality, capacity and hardware needs.
• Explore open-weight LLMs and quantisation techniques (FP8, INT8, NVFP4).
• Design input/output filtering and guardrails for secure deployments.
• Work with Kubernetes and Python to support scalable inference environments.

Skills

LLM inference

GPU optimization

Production platforms

Kubernetes

Python

Benchmarking

Performance tuning

Security for enterprise

Tools

vLLM

NVIDIA GPUs

KServe

llm-d

CUDA

Job description

Empiric seeks a Senior AI Inference Engineer to lead production LLM inference on GPU infrastructure and secure enterprise deployments. You will optimise GPU-based AI workloads, benchmark model performance, and help scale high-performance inference across multi-GPU setups.

You will design and implement efficient serving frameworks, quantisation strategies, and routing for enterprise environments. Strong collaboration with engineering teams is essential to deliver reliable, scalable AI solutions.