Remote AI Backend Engineer: Build Low-Latency AI Systems

SmartRecruiters, Inc.; San Francisco (CA); Remote; USD 140,000 - 200,000; Full time

Benefits offered by this job

Medical insurance

Dental

Vision

Savings Plan

Paid Time Off

Job summary

Parallel Partners is seeking an AI Backend Engineer to build and operate scalable, low-latency backend systems powering AI-driven decisioning and automation. This fully remote role sits with a global engineering team, connecting models, APIs, and product workflows.

You will design AI orchestration layers, build inference pipelines, and optimize latency, throughput, and cost while ensuring reliability and observability across distributed services.

Qualifications

• Experience building backend systems powering AI workflows.
• Strong understanding of APIs, data flows, and system design.
• Familiarity with AI systems (LLMs, embeddings, AI workflows).
• Ability to debug production distributed systems.

Responsibilities

• Build and operate backend systems that serve AI-powered workflows in production.
• Design and implement AI orchestration layers connecting models, APIs, workflows.
• Build inference pipelines for LLM-based automation.
• Optimize latency, throughput, and cost across AI services.
• Define stable service boundaries between backend, ML components, and product APIs.
• Implement observability: logging, metrics, tracing, alerting.

Skills

Backend engineering

AI/ML systems

Distributed systems

Observability

Low latency

Tools

Docker

Kubernetes

Node.js

Python

SQL

NoSQL

LLM APIs

Job description

Parallel Partners is seeking an AI Backend Engineer to build and operate scalable, low-latency backend systems powering AI-driven decisioning and automation. This fully remote role sits with a global engineering team, connecting models, APIs, and product workflows.

You will design AI orchestration layers, build inference pipelines, and optimize latency, throughput, and cost while ensuring reliability and observability across distributed services.