AI Backend Engineer — Low-Latency Inference & Orchestration

ActAI; United States; On-site; USD 120,000 - 180,000; Full time

Job summary

ActAI is seeking a Backend Engineer to own the inference and orchestration layer powering AI interactions. You will build and operate production systems that turn model capability into fast, stable APIs used across mobile and desktop clients.

Focus on latency, correctness, reliability, and cost; design pipelines and service boundaries; monitor and respond to incidents; optimize throughput with batching and caching. Experience with Python, NodeJs, PyTorch, and Docker preferred.

Qualifications

• Experience running high-throughput, low-latency services.
• Experience with AI inference patterns (LLMs, embeddings, multimodal).
• Bias toward shipping and learning from production behavior.

Responsibilities

• Build and operate backend systems serving AI-powered features in production.
• Design inference pipelines and service boundaries around models.
• Own production concerns: monitoring, logging, and incident response.
• Optimize latency and throughput across inference, batching, and caching.

Skills

Python

Node.js

Pytorch

AI inference

SQL

NoSQL

Docker

Tools

APIs

Job description

ActAI is seeking a Backend Engineer to own the inference and orchestration layer powering AI interactions. You will build and operate production systems that turn model capability into fast, stable APIs used across mobile and desktop clients.

Focus on latency, correctness, reliability, and cost; design pipelines and service boundaries; monitor and respond to incidents; optimize throughput with batching and caching. Experience with Python, NodeJs, PyTorch, and Docker preferred.