Realtime ML Systems Engineer - High-Performance Inference

Inworld AI; United Kingdom; On-site; GBP 140,000 - 200,000; Full time

Job summary

A leading AI research lab is seeking talented individuals to develop sophisticated multimodal models and optimization techniques. The ideal candidate will have a PhD or equivalent experience in CS, Physics, or Math, with proficiency in high-performance systems and distributed scaling solutions. Responsibilities include taking models into production and ensuring performance and reliability across thousands of queries per second. The position offers a base salary of £140,000 – £200,000, along with equity and benefits.

Qualifications

• Deep understanding of modern serving frameworks and optimization techniques.
• Hands-on experience with model quantization and caching strategies.
• Proficiency in performance optimization on NVIDIA GPUs.

Responsibilities

• Work on agentic systems and multimodal inference at scale.
• Take models from the research team and optimize their serving.
• Ensure reliability in production environments.

Skills

Inference Optimization

Model Acceleration

High-Performance Systems

Distributed Systems & Scaling

Public work

Full-cycle ownership

Background in CS, Physics, Math

Education

PhD in CS, Physics, Math or equivalent experience

Tools

C++

CUDA

Rust

Python

Kubernetes

Ray

Job description

A leading AI research lab is seeking talented individuals to develop sophisticated multimodal models and optimization techniques. The ideal candidate will have a PhD or equivalent experience in CS, Physics, or Math, with proficiency in high-performance systems and distributed scaling solutions. Responsibilities include taking models into production and ensuring performance and reliability across thousands of queries per second. The position offers a base salary of £140,000 – £200,000, along with equity and benefits.