Remote AI Backend Engineer: Build Low-Latency AI Systems

Parallel Partners, Inc.; San Francisco (CA); Remote; USD 120,000 - 210,000; Full time

Job summary

Parallel Partners, Inc. is seeking an AI Backend Engineer to design and operate scalable, low-latency backend systems powering AI-driven decisioning and automation. This fully remote role sits with a global engineering team, connecting models, APIs, and product workflows.

You will design AI orchestration layers, build inference pipelines, and optimize latency, throughput, and cost while ensuring reliability and observability across distributed services.

Responsibilities

• Design AI orchestration layers for scalable deployments.
• Build and optimize inference pipelines to improve latency and throughput.

Job description

Parallel Partners is seeking an AI Backend Engineer to build and operate scalable, low-latency backend systems powering AI-driven decisioning and automation. This fully remote role sits with a global engineering team, connecting models, APIs, and product workflows.

You will design AI orchestration layers, build inference pipelines, and optimize latency, throughput, and cost while ensuring reliability and observability across distributed services.