Senior Backend Engineer — AI Agent & Data Orchestration

People In AI

San Mateo (CA)

Hybrid

USD 250,000 - 300,000

Full time

16 hours ago
Be an early applicant
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Job summary

People In AI in San Mateo is seeking a Senior Backend Engineer to build the infrastructure for an AI-native SaaS platform, with a focus on agent harnesses, orchestration, and production-grade systems.

You will own end-to-end development from prototype through deployment, working across data pipelines, geospatial and multimodal datasets, and collaborating with AI engineers to deliver reliable, scalable solutions for complex real-world problems.

Qualifications

  • 5+ years of professional software engineering experience building complex applications or distributed systems.
  • Strong Python engineering skills and production-quality software.
  • Deep experience designing backend services, APIs, data models, and production systems.
  • Experience building AI agent infrastructure, agent orchestration systems, LLM applications, or model-serving platforms.
  • Reliability, state management, observability, latency, and failure handling in production systems.

Responsibilities

  • Design and build production-grade backend services powering an AI-native SaaS platform.
  • Build agent harnesses and execution infrastructure for sophisticated AI workflows.
  • Develop systems for orchestrating multi-step agent interactions across models, tools, APIs, databases, and services.
  • Design abstractions around tool calling, state management, retries, fallbacks, and failure recovery.
  • Create agent runtimes supporting dynamic model-driven behavior and deterministic logic.
  • Enhance infrastructure for evaluation, tracing, debugging, observability, and performance monitoring.
  • Establish guardrails and execution patterns for reliable agentic workflows in production.
  • Work on model routing, inference workflows, asynchronous execution, and long-running tasks.
  • Collaborate with AI engineers to scale experimental capabilities into production systems.
  • Build services supporting inference, optimization, and compute-heavy ML tasks.
  • Design scalable data models for geospatial, regulatory, structured, unstructured, and multimodal data.
  • Develop data ingestion/orchestration pipelines to serve agents and models.
  • Develop reproducible deployment workflows and IaC practices.
  • Own new technical capabilities end to end from prototype to production deployment.
  • Help shape engineering patterns and architectural decisions as the platform scales.

Skills

Python
Backend engineering
Distributed systems
AI agent infrastructure
Reliability & observability

Education

Bachelor's degree in Computer Science or equivalent

Tools

APIs
Data pipelines
SQL/NoSQL

Job description

People In AI in San Mateo is seeking a Senior Backend Engineer to build the infrastructure for an AI-native SaaS platform, with a focus on agent harnesses, orchestration, and production-grade systems.

You will own end-to-end development from prototype through deployment, working across data pipelines, geospatial and multimodal datasets, and collaborating with AI engineers to deliver reliable, scalable solutions for complex real-world problems.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior AI Engineer – Backend & Data Orchestration
Senior AI Engineer – Backend & Data Orchestration

Whirl AI • San Francisco (CA)

Hybrid
USD 180,000 - 240,000
Equity
Health plan coverage
Hybrid work model
Senior Backend Engineer - AI Agent Platform
Senior Backend Engineer - AI Agent Platform

Lightning • New York (NY)

Hybrid
USD 180,000 - 250,000
Health coverage
Equity (RSUs)
401(k) matching
+3
Backend Engineer, Agent Orchestration & Systems
Backend Engineer, Agent Orchestration & Systems

Slope • San Francisco (CA)

On-site
USD 220,000 - 280,000
Senior Staff Backend Engineer — AI Agent Orchestration
Senior Staff Backend Engineer — AI Agent Orchestration

Moveworks • Mountain View (CA), Northern (KY)

Hybrid
USD 210,000 - 260,000
Senior Backend Engineer
Senior Backend Engineer

People In AI • San Mateo (CA)

Hybrid
USD 250,000 - 300,000
Senior AI Backend Engineer | Equity & Production AI
Senior AI Backend Engineer | Equity & Production AI

Within • San Francisco (CA)

On-site
USD 180,000 - 260,000
Equity
100% Employer-Paid Medical, Dental & 0
Paid Parental Leave
+6
AI Backend Engineer: Scale Enterprise AI Systems
AI Backend Engineer: Scale Enterprise AI Systems

Within • San Francisco (CA)

On-site
USD 140,000 - 190,000
Equity
Employer-Paid Medical
Parental Leave
+5
Staff Backend Engineer - AI-Native Orchestration
Staff Backend Engineer - AI-Native Orchestration

Town • San Francisco (CA)

On-site
USD 120,000 - 180,000
Backend Engineer — Real-Time AI Orchestration
Backend Engineer — Real-Time AI Orchestration

Hark • San Jose (CA)

On-site
USD 170,000 - 400,000
Senior Backend Engineer, AI Platform
Senior Backend Engineer, AI Platform

Writer • New York (NY), Northern (KY)

Hybrid
USD 180,000 - 240,000