AI Backend Engineer — Inference & Orchestration

Bjak; Germany (OH); On-site; USD 110,000 - 150,000; Full time

Job summary

A1 is seeking a Backend Engineer, AI, to own the inference and orchestration layer powering AI interactions across the product. You will build and operate production systems that turn model capability into fast, stable APIs used by mobile and desktop clients.

Focus on latency, reliability, and cost, with strong emphasis on monitoring, logging, and incident response. You will work with Python, NodeJs, PyTorch, and various LLMs to deliver scalable AI-enabled features.

Qualifications

• Strong backend fundamentals in production environments.
• Experience running high-throughput, low-latency services.
• Familiarity with AI inference patterns (LLMs, embeddings, multimodal).

Responsibilities

• Build and operate backend systems that serve AI-powered features in production.
• Design inference pipelines, orchestration layers, and service boundaries around models.
• Own production concerns: monitoring, logging, alerting, and incident response.
• Optimize latency and throughput across inference, caching, batching, and streaming.

Skills

Backend engineering

Low-latency systems

AI inference patterns

Distributed systems debugging

Tools

Kubernetes

Docker

PyTorch

OpenAI/Anthropic/LLMs

SQL & NoSQL

Job description

A1 is seeking a Backend Engineer, AI, to own the inference and orchestration layer powering AI interactions across the product. You will build and operate production systems that turn model capability into fast, stable APIs used by mobile and desktop clients.

Focus on latency, reliability, and cost, with strong emphasis on monitoring, logging, and incident response. You will work with Python, NodeJs, PyTorch, and various LLMs to deliver scalable AI-enabled features.