Senior AI Inference & Systems Engineer

Nebius Group; Greater London; Hybrid; GBP 100,000 - 150,000; Full time

Benefits offered by this job

Competitive compensation

Career growth and learning

Flexibility and ownership

Collaborative and innovative culture

Impactful AI projects

International environment and talented

Job summary

Nebius seeks a Senior Machine Learning Engineer for its Applied AI team. Own model and endpoint optimization from artifacts to production deployment, spanning internals, quantization, and benchmarking to improve latency, throughput, memory use, and cost per token while preserving quality.

Collaborate with kernel and platform engineers to evaluate configurations, diagnose regressions, and ensure safe production rollouts under real workloads.

Qualifications

• Experience deploying or optimizing LLM/VLM or high-throughput transformer inference.
• Strong understanding of transformer inference bottlenecks: KV cache, attention, memory bandwidth.
• Experience designing or optimizing distributed inference system architecture.

Responsibilities

• Own optimization projects for model families, endpoints, or backends.

Skills

Python

PyTorch

LLM optimization

Distributed inference

Tools

vLLM

SGLang

TensorRT-LLM

Triton Inference Server

NVIDIA Dynamo

Ray Serve

KServe

Job description

Nebius seeks a Senior Machine Learning Engineer for its Applied AI team. Own model and endpoint optimization from artifacts to production deployment, spanning internals, quantization, and benchmarking to improve latency, throughput, memory use, and cost per token while preserving quality.

Collaborate with kernel and platform engineers to evaluate configurations, diagnose regressions, and ensure safe production rollouts under real workloads.