Senior Real-Time ML Systems Engineer

BITKRAFT Ventures; United Kingdom; On-site; GBP 140,000 - 200,000; Full time

Job summary

Inworld, a research lab powering realtime AI, seeks engineers who can take models from research to production. You will optimize serving latency, scale across GPUs, and own end-to-end deployment of complex ML systems.

The role emphasizes practical impact, speed, and reliability, with equity and benefits as part of total compensation. UK visa work rights required; relocation support may be considered.

Qualifications

• Inference optimization using modern serving frameworks and techniques.
• Hands-on model acceleration with quantization, distillation, caching, and speculative decoding.
• Proficiency in C++, CUDA, Rust, or optimized Python and profiling for NVIDIA GPUs.
• Experience with Kubernetes, Ray, multi-GPU/multi-node inference and scalable systems.

Skills

Inference Optimization

Model Acceleration

High-Performance Systems

Distributed Systems & Scaling

Public work

Education

PhD in CS, Physics, Math, or equivalent

Tools

Kubernetes

Ray

CUDA

vLLM

Profiling/Optimization

Job description

Inworld, a research lab powering realtime AI, seeks engineers who can take models from research to production. You will optimize serving latency, scale across GPUs, and own end-to-end deployment of complex ML systems.

The role emphasizes practical impact, speed, and reliability, with equity and benefits as part of total compensation. UK visa work rights required; relocation support may be considered.