AI Backend Engineer — Low-Latency, High-Throughput

ActAI; Ireland; On-site; EUR 90,000 - 130,000; Full time

Job summary

ActAI is seeking a Backend Engineer, AI to own the inference and orchestration layer powering every AI interaction in our product. You will build and operate production systems turning model capabilities into fast, stable APIs used across mobile and desktop clients.

You will design inference pipelines, manage routing, caching, batching, and state management while optimizing latency, throughput and cost. Collaborate with ML and product teams to translate model capabilities into robust,

Qualifications

• Experience running high-throughput, low-latency services.
• Familiarity with AI inference patterns (LLMs, embeddings, multimodal).
• Bias toward shipping and learning from production behavior.

Responsibilities

• Build and operate backend systems that serve AI-powered features in production.
• Design inference pipelines and orchestration layers that handle multi-step workflows, tool calls, and retries.
• Manage the full lifecycle of AI requests: routing, caching, batching, streaming, and state management.
• Optimize latency, throughput, and cost across model inference and downstream systems.
• Design systems that remain reliable despite non-deterministic model behavior and external dependencies.
• Implement observability for AI systems, including logging, tracing, and debugging of model outputs and failures.
• Collaborate with ML and product teams to translate model capabilities into stable, production-grade APIs.

Skills

High-throughput systems

Low-latency design

Production observability

Cost optimization

Tools

Python

NodeJs

Pytorch

OpenAI / Anthropic / open-source LLMs

SQL & noSQL

Docker

Job description

ActAI is seeking a Backend Engineer, AI to own the inference and orchestration layer powering every AI interaction in our product. You will build and operate production systems turning model capabilities into fast, stable APIs used across mobile and desktop clients.

You will design inference pipelines, manage routing, caching, batching, and state management while optimizing latency, throughput and cost. Collaborate with ML and product teams to translate model capabilities into robust,