Backend AI Engineer: Scalable Inference & Orchestration

re-zoo-me; San Francisco, Northern (CA, KY); Hybrid; USD 150,000 - 190,000; Full time

Job summary

ActAI is seeking a Backend Engineer, AI to own the inference and orchestration layer powering all AI interactions in the product. You will build and operate production systems that turn model capability into fast, stable APIs used across mobile and desktop clients.

You should have strong backend fundamentals, experience with high-throughput, low-latency services, and familiarity with AI inference patterns (LLMs, embeddings, multimodal).

Qualifications

• Strong backend engineering fundamentals in production environments.
• Experience running high-throughput, low-latency services.
• Familiarity with AI inference patterns (LLMs, embeddings, multimodal).
• Comfortable debugging distributed systems under load.
• Bias toward shipping and learning from production behaviour.

Responsibilities

• Build and operate backend systems that serve AI-powered features in production.
• Design inference pipelines, orchestration layers, and service boundaries around models.
• Own production concerns: monitoring, logging, alerting, and incident response.
• Optimize latency and throughput across inference, caching, batching, and streaming.

Job description

ActAI is seeking a Backend Engineer, AI to own the inference and orchestration layer powering all AI interactions in the product. You will build and operate production systems that turn model capability into fast, stable APIs used across mobile and desktop clients.

You should have strong backend fundamentals, experience with high-throughput, low-latency services, and familiarity with AI inference patterns (LLMs, embeddings, multimodal).