Senior AI Inference Engineer — Hybrid, Enterprise LLM

Next Ventures; Amsterdam; Hybrid; EUR 120,000 - 180,000; Full time

Benefits offered by this job

Hybrid work model

Job summary

Next Ventures is seeking a Senior AI Inference Engineer for government clients in the Netherlands, with hybrid work in Amstelveen or Eindhoven. You will own AI tooling and infrastructure lifecycles, deciding model-to-hardware deployment strategies, capacity planning, and performance optimization within an autonomous Scrum team.

The role requires production GPU LLM serving experience, strong knowledge of KV caching, batching, quantisation, and ADR-driven architecture decisions.

Qualifications

• Extensive experience building enterprise ML platforms.
• Proven track record in production GPU LLM serving.
• Strong knowledge of caching, batching and quantisation.

Responsibilities

• Benchmark an 8x H200 node: tensor parallelism versus replicas; measure throughput and latency.
• Translate results into customer-facing capacity models: tokens/min and requests/min per model/GPU.
• Build catalogue benchmarks covering performance, quality evaluation and hardware requirements.
• Design input/output content filtering using self-hosted open-weight models.
• Assess model licences, NVFP4/FP8/INT8 quantisation, memory fit and serving configurations.

Skills

Python

LLM serving

Kubernetes

GPU benchmarking

Quantisation

KV cache

ADRs

Tensor parallelism

Tools

vLLM

NVLink

Kubernetes

Job description

Next Ventures is seeking a Senior AI Inference Engineer for government clients in the Netherlands, with hybrid work in Amstelveen or Eindhoven. You will own AI tooling and infrastructure lifecycles, deciding model-to-hardware deployment strategies, capacity planning, and performance optimization within an autonomous Scrum team.

The role requires production GPU LLM serving experience, strong knowledge of KV caching, batching, quantisation, and ADR-driven architecture decisions.