Remote AI Backend Engineer: Build Low-Latency AI Systems

Parallel Partners, Inc.

San Francisco (CA)

Remote

USD 140,000 - 200,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Medical insurance
Dental
Vision
Savings Plan
Paid Time Off

Job summary

Parallel Partners is seeking an AI Backend Engineer to build and operate scalable, low-latency backend systems powering AI-driven decisioning and automation. This fully remote role sits with a global engineering team, connecting models, APIs, and product workflows.

You will design AI orchestration layers, build inference pipelines, and optimize latency, throughput, and cost while ensuring reliability and observability across distributed services.

Qualifications

  • Experience building backend systems powering AI workflows.
  • Strong understanding of APIs, data flows, and system design.
  • Familiarity with AI systems (LLMs, embeddings, AI workflows).
  • Ability to debug production distributed systems.

Responsibilities

  • Build and operate backend systems that serve AI-powered workflows in production.
  • Design and implement AI orchestration layers connecting models, APIs, workflows.
  • Build inference pipelines for LLM-based automation.
  • Optimize latency, throughput, and cost across AI services.
  • Define stable service boundaries between backend, ML components, and product APIs.
  • Implement observability: logging, metrics, tracing, alerting.

Skills

Backend engineering
AI/ML systems
Distributed systems
Observability
Low latency

Tools

Docker
Kubernetes
Node.js
Python
SQL
NoSQL
LLM APIs

Job description

Parallel Partners is seeking an AI Backend Engineer to build and operate scalable, low-latency backend systems powering AI-driven decisioning and automation. This fully remote role sits with a global engineering team, connecting models, APIs, and product workflows.

You will design AI orchestration layers, build inference pipelines, and optimize latency, throughput, and cost while ensuring reliability and observability across distributed services.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Backend Systems Engineer
AI Backend Systems Engineer

Blue Signal LLC. • Savannah (GA)

Remote
USD 140,000 - 190,000
Fully remote nationwide
Competitive compensation
Back End Engineer, AI Systems
Back End Engineer, AI Systems

Salt • United States

On-site
USD 140,000 - 190,000
Remote AI Backend Engineer: Scalable, Production-Ready
Remote AI Backend Engineer: Scalable, Production-Ready

Blue Signal LLC. • Savannah (GA)

Remote
USD 140,000 - 190,000
Fully remote nationwide
Competitive compensation
Remote Backend Engineer: AI Infrastructure
Remote Backend Engineer: AI Infrastructure

Alignerr Corp. • United States

Remote
USD 55,000 - 124,000
Fully remote
Flexible hours
Potential for ongoing work
Remote Staff Backend AI Engineer for Scalable AI Systems
Remote Staff Backend AI Engineer for Scalable AI Systems

ByteHire Limited. • New York (NY)

Remote
USD 150,000 - 250,000
Generous PTO
Health insurance
Life and disability insurance
+2
Senior Backend & AI Platform Engineer (Low-Latency)
Senior Backend & AI Platform Engineer (Low-Latency)

Pokee AI • United States

Remote
USD 120,000 - 180,000
Senior Backend & AI Platform Developer
Senior Backend & AI Platform Developer

Navigator HR • United States

Remote
USD 120,000 - 180,000
Senior AI Platform Backend Engineer (Remote)
Senior AI Platform Backend Engineer (Remote)

Affirm, Inc. • Boston (MA)

Remote
USD 173,000 - 233,000
Health coverage 100% for employees and
Monthly tech stipends
Senior Backend Engineer - AI Inference & Low-Latency
Senior Backend Engineer - AI Inference & Low-Latency

Fdetimes • San Francisco (CA)

On-site
USD 200,000 - 290,000
Startup equity
Health insurance
Backend Engineer: Scalable AI Platform (Hybrid/Remote)
Backend Engineer: Scalable AI Platform (Hybrid/Remote)

Relativity • Alabama

Hybrid
USD 79,000 - 119,000
Health and retirement programs
Discretionary time off (DTO)
Home office stipend
+1