Backend AI Engineer: Inference & Orchestration

ActAI; United States; On-site; USD 140,000 - 210,000; Full time

Job summary

ActAI is seeking a Backend Engineer, AI, to own the inference and orchestration layer powering every AI interaction in the product. You will build and operate production systems that turn model capability into fast, stable, observable APIs used across mobile and desktop clients.

Ideal candidates have experience running high-throughput, low-latency services and familiarity with AI inference patterns (LLMs, embeddings, multimodal).

Qualifications

• Experience running high-throughput, low-latency services.
• Familiarity with AI inference patterns (LLMs, embeddings, multimodal).
• Bias toward shipping and learning from production behavior.

Responsibilities

• Own inference pipelines and orchestration layers.
• Build and operate production systems turning models into fast, stable APIs.
• Monitor, log, alert, and incident response for production systems.
• Optimize latency and throughput across caching, batching, and streaming.

Skills

High throughput services

Low latency design

AI inference patterns

Tools

Python

NodeJs

Pytorch

SQL/NoSQL

Docker

Job description

ActAI is seeking a Backend Engineer, AI, to own the inference and orchestration layer powering every AI interaction in the product. You will build and operate production systems that turn model capability into fast, stable, observable APIs used across mobile and desktop clients.

Ideal candidates have experience running high-throughput, low-latency services and familiarity with AI inference patterns (LLMs, embeddings, multimodal).