Backend AI Engineer: Low-Latency Inference & Orchestration

United States Digital Space LLC; United States; Remote; USD 120,000 - 150,000; Full time

Job summary

ActAI is seeking a Backend Engineer, AI to own the inference and orchestration layer powering AI interactions across the product. You will build and operate production systems turning model capability into fast, stable APIs used by mobile and desktop clients.

Ideal candidates will have strong backend fundamentals, experience with high-throughput services, and familiarity with AI inference patterns, including LLMs and embeddings.

Qualifications

• Strong backend engineering fundamentals in production environments.
• Experience running high-throughput, low-latency services.
• Familiarity with AI inference patterns (LLMs, embeddings, multimodal).
• Comfortable debugging distributed systems under load.

Responsibilities

• Build and operate backend systems that serve AI-powered features in production.
• Design inference pipelines, orchestration layers, and service boundaries around models.
• Own production concerns: monitoring, logging, alerting, and incident response.
• Optimize latency and throughput across inference, caching, batching, and streaming.

Skills

Backend engineering

High-throughput services

Debugging distributed systems

Tools

Python

NodeJs

Pytorch

OpenAI/Anthropic LLMs

SQL/NoSQL

Kubernetes

Docker

Job description

ActAI is seeking a Backend Engineer, AI to own the inference and orchestration layer powering AI interactions across the product. You will build and operate production systems turning model capability into fast, stable APIs used by mobile and desktop clients.

Ideal candidates will have strong backend fundamentals, experience with high-throughput services, and familiarity with AI inference patterns, including LLMs and embeddings.