Senior AI Orchestration Architect — Agent Platform & Latency

Jack & Jill

Palo Alto (CA)

On-site

USD 200,000 - 260,000

Part time

14 days+
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Benefits offered by this job

Equity

Job summary

Jack & Jill is seeking a senior software engineering leader to design and own the agent platform architecture, with a focus on orchestration and reasoning systems for live patient interactions. You will build robust failure handling and optimize the AI stack for latency, cost, and correctness.

The role requires 7+ years of experience and deep expertise in LLM orchestration and debugging complex non-deterministic systems.

Qualifications

  • Requires 7+ years of software engineering experience with a track record of building production AI or conversational systems.
  • Deep expertise in LLM orchestration and debugging complex non-deterministic systems is essential.

Skills

LLM Orchestration
Agent Platform Architecture
Software Engineering
Conversational Systems
System Design
Failure Handling
Latency Optimization
Telephony Infrastructure
Multi-step Reasoning Workflows
Production AI Operations

Job description

Jack & Jill is seeking a senior software engineering leader to design and own the agent platform architecture, with a focus on orchestration and reasoning systems for live patient interactions. You will build robust failure handling and optimize the AI stack for latency, cost, and correctness.

The role requires 7+ years of experience and deep expertise in LLM orchestration and debugging complex non-deterministic systems.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior AI Platform Engineer - Agent Orchestration & SDLC
Senior AI Platform Engineer - Agent Orchestration & SDLC

Anblicks • Dallas (TX)

On-site
USD 140,000 - 190,000
Senior Full Stack Engineer - AI Platform & Agent Orchestration
Senior Full Stack Engineer - AI Platform & Agent Orchestration

Anblicks • Dallas (TX)

On-site
USD 140,000 - 190,000
Senior AI Agent Systems Architect
Senior AI Agent Systems Architect

hackajob • Seattle (WA)

On-site
USD 180,000 - 240,000
Health care coverage
On-site health and wellness centers
Retirement savings plan
+4
Production AI & Agent Architect (Healthcare)
Production AI & Agent Architect (Healthcare)

Jobtailor • United States

On-site
USD 180,000 - 280,000
Senior AI Platform Engineer: Multi-Agent Orchestration
Senior AI Platform Engineer: Multi-Agent Orchestration

Glover Labs • San Francisco (CA)

On-site
USD 130,000 - 160,000
Senior AI Engineer for Health Agent Systems (Remote)
Senior AI Engineer for Health Agent Systems (Remote)

Function Health • United States

On-site
USD 140,000 - 210,000
Senior AI Agent Architect & LLM Platform Lead
Senior AI Agent Architect & LLM Platform Lead

Ll Oefentherapie • United States

On-site
USD 96,000 - 252,000
Medical, dental, and vision insurance
Short term & long term disability
Life insurance
+5
Senior Backend Engineer - AI Agent Platform
Senior Backend Engineer - AI Agent Platform

Lightning • New York (NY)

Hybrid
USD 180,000 - 250,000
Health coverage
Equity (RSUs)
401(k) matching
+3
Senior AI Platform & Agent Engineering Leader
Senior AI Platform & Agent Engineering Leader

Oracle • United States

On-site
USD 133,000 - 307,000
Medical, dental, and vision insurance
401(k) Savings and Investment Plan
Paid time off
+2
Senior AI Agent Architect - Lead Cross-Squad Orchestration
Senior AI Agent Architect - Lead Cross-Squad Orchestration

IT Labs • Union (NJ), Northern (KY)

Hybrid
USD 105,000 - 174,000
PTO provided
Remote work