Backend AI Engineer - Inference & Orchestration

United States Digital Space LLC

Germany (OH)

On-site

USD 120,000 - 180,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

United States Digital Space LLC is seeking a Backend Engineer, AI, to own the inference and orchestration layer that powers every AI interaction in our product. You will build and operate production systems that turn model capability into fast, stable APIs used across mobile and desktop clients.

You will design inference pipelines, orchestration layers, and service boundaries around models, while owning production concerns like monitoring, logging, and incident response to keep latency low and

Qualifications

  • Experience building production-grade backend services.
  • Strong understanding of low-latency, high-throughput systems.
  • Familiarity with AI inference patterns (LLMs, embeddings, multimodal).

Responsibilities

  • Design inference pipelines and orchestration layers around models.
  • Own production concerns: monitoring, logging, and incident response.
  • Optimize latency and throughput across inference, caching, batching, and streaming.

Skills

Backend engineering
Distributed systems
Python
Kubernetes
Docker
LLMs
Monitoring

Tools

Docker
Kubernetes
PyTorch
OpenAI API
SQL/NoSQL

Job description

United States Digital Space LLC is seeking a Backend Engineer, AI, to own the inference and orchestration layer that powers every AI interaction in our product. You will build and operate production systems that turn model capability into fast, stable APIs used across mobile and desktop clients.

You will design inference pipelines, orchestration layers, and service boundaries around models, while owning production concerns like monitoring, logging, and incident response to keep latency low and

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

AI Backend Engineer: Inference & Orchestration at Scale
AI Backend Engineer: Inference & Orchestration at Scale

Bjak • Town of Sweden (NY)

On-site
USD 120,000 - 160,000
AI Backend Engineer: Scalable Inference & Orchestration
AI Backend Engineer: Scalable Inference & Orchestration

Bjak • Town of Poland (NY)

On-site
USD 140,000 - 190,000
AI Backend Engineer — Inference & Orchestration
AI Backend Engineer — Inference & Orchestration

Bjak • Germany (OH)

On-site
USD 110,000 - 150,000
Backend AI Engineer: Production-Grade Inference
Backend AI Engineer: Production-Grade Inference

European Recruitment BV • United States

On-site
USD 120,000 - 160,000
AI Backend Engineer: Inference & Orchestration
AI Backend Engineer: Inference & Orchestration

A1 • Palo Alto (CA)

On-site
USD 150,000 - 210,000
Senior Systems Engineer, AI Inference Infra
Senior Systems Engineer, AI Inference Infra

United States Digital Space LLC • United States

Remote
USD 150,000 - 190,000
Backend Engineer, AI (Agent Systems)
Backend Engineer, AI (Agent Systems)

European Recruitment BV • United States

On-site
USD 120,000 - 160,000
Senior Backend Engineer - AI Agent Platform
Senior Backend Engineer - AI Agent Platform

United States Digital Space LLC • United States

Remote
USD 181,000 - 226,000
Agentic AI Orchestration Engineer
Agentic AI Orchestration Engineer

United States Digital Space LLC • United States

Remote
USD 120,000 - 180,000
Remote Backend Engineer - AI-Driven Speech Platform
Remote Backend Engineer - AI-Driven Speech Platform

United States Digital Space LLC • United States

Remote
USD 150,000 - 220,000
Equity
Annual Bonus
Remote work