AI Inference Backend Engineer

ActAI; Greater London; On-site; GBP 60,000 - 90,000; Full time

Job summary

ActAI is seeking a Backend Engineer to own the inference and orchestration layer powering AI interactions across the product. You will build and operate production systems that turn model capability into fast, stable, observable APIs used by mobile and desktop clients.

You will focus on high-throughput, low-latency services, designing pipelines and boundaries around models, and owning monitoring, logging, and incident response to ensure reliability at scale.

Qualifications

• Experience running high-throughput, low-latency services.
• Familiarity with AI inference patterns (LLMs, embeddings, multimodal).
• Bias toward shipping and learning from production behavior.

Responsibilities

• Build and operate backend systems that serve AI-powered features in production.
• Design inference pipelines, orchestration layers, and service boundaries around models.
• Own production concerns: monitoring, logging, alerting, and incident response.
• Optimize latency and throughput across inference, caching, batching, and streaming.

Skills

Backend engineering

AI inference

Low-latency services

Tools

Docker

Python

Node.js

Pytorch

SQL

NoSQL

Job description

ActAI is seeking a Backend Engineer to own the inference and orchestration layer powering AI interactions across the product. You will build and operate production systems that turn model capability into fast, stable, observable APIs used by mobile and desktop clients.

You will focus on high-throughput, low-latency services, designing pipelines and boundaries around models, and owning monitoring, logging, and incident response to ensure reliability at scale.