AI Backend Engineer, Artificial Intelligence (AI) Required, Work From Home

SmartRecruiters, Inc.; San Francisco (CA); Remote; USD 140,000 - 200,000; Full time

Benefits offered by this job

Medical insurance

Dental

Vision

Savings Plan

Paid Time Off

Job summary

Parallel Partners is seeking an AI Backend Engineer to build and operate scalable, low-latency backend systems powering AI-driven decisioning and automation. This fully remote role sits with a global engineering team, connecting models, APIs, and product workflows.

You will design AI orchestration layers, build inference pipelines, and optimize latency, throughput, and cost while ensuring reliability and observability across distributed services.

Qualifications

• Experience building backend systems powering AI workflows.
• Strong understanding of APIs, data flows, and system design.
• Familiarity with AI systems (LLMs, embeddings, AI workflows).
• Ability to debug production distributed systems.

Responsibilities

• Build and operate backend systems that serve AI-powered workflows in production.
• Design and implement AI orchestration layers connecting models, APIs, workflows.
• Build inference pipelines for LLM-based automation.
• Optimize latency, throughput, and cost across AI services.
• Define stable service boundaries between backend, ML components, and product APIs.
• Implement observability: logging, metrics, tracing, alerting.

Skills

Backend engineering

AI/ML systems

Distributed systems

Observability

Low latency

Tools

Docker

Kubernetes

Node.js

Python

SQL

NoSQL

LLM APIs

Job description

AI Backend Engineer, Artificial Intelligence (AI) Required, Work From Home

• Full-time
• Compensation: USD 140,000 - USD 200,000 - yearly

AI Backend Engineer, Artificial Intelligence (AI) Required, Work From Home

We are looking for talented AI Backend Engineers to build systems that power AI-driven decisioning, automation, and orchestration across our platform. This role sits at the core of our AI stack, between models, backend systems, and real users, where latency, correctness, reliability, and cost directly impact production experience. This is a fully remote position where you will be part of a global engineering team working across multiple countries to build reliable, scalable AI systems. This position is 100% Remote.

MUST BE WILLING TO TAKE A 60 MINUTE CODING ASSESSMENT.

- Build and operate backend systems that serve AI-powered insurance workflows in production.

- Design and implement AI orchestration layers that connect models, APIs, workflows, and business logic.

- Build inference pipelines for LLM-based and AI-assisted automation systems.

- Optimize latency, throughput, and cost across AI services (caching, batching, streaming, routing).

- Design stable service boundaries between backend systems, ML components, and product APIs.

- Implement observability: logging, metrics, tracing, alerting, and incident response workflows.

- Debug production issues across distributed AI systems and resolve root causes.

- Collaborate closely with frontend, product, operations, and ML teams to ship end-to-end features.

- Continuously improve system reliability, scalability, and performance.

- AI backend systems run reliably at scale with low latency and high availability.

- AI workflows are stable, observable, and production-ready across multiple products.

- System performance improves continuously through real-world feedback and optimization.

- Production incidents are quickly detected, diagnosed, and resolved.

- AI capabilities are seamlessly integrated into global customer and internal workflows.

- Artificial Intelligence (AI) experience required.

- Experience building or operating high-throughput, low-latency services.

- Familiarity with AI Systems (LLMs, Embeddings, or AI Workflows).

- Experience with distributed systems and production debugging.

- Strong understanding of APIs, data flows, and system design principles.

- Experience with observability tools (logging, monitoring, tracing).

- Strong ownership mindset and bias toward shipping.

- Comfortable working in fast-paced, globally distributed teams.

Tech Stack: Anthropic, Claude, Artificial Intelligence (AI), Distributed Systems Tooling, Docker, Kubernetes, LLM APIs, Node.js, NoSQL, Observability Tools, OpenAI, Open-Source Models, Python, SQL.

Benefits include medical insurance, Dental, Vision, Savings Plan Options, PTO, etc.

Keywords: San Francisco CA Jobs, AI Backend Engineer, AI, Anthropic, Artificial Intelligence, Claude, Distributed Systems Tooling, Docker, Kubernetes, LLM APIs, Low Latency, Node.js, NoSQL, Observability Tools, OpenAI, Open-Source Models, Python, SQL, Software Engineer, Software Developer, Programming, Programmer Analyst, Work From Home, Remote, California Recruiters, IT Jobs, California Recruiting

All your information will be kept confidential according to EEO guidelines.