Senior AI Orchestration Engineer (Remote)

zipcolimited

United States

Remote

USD 162,000 - 205,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Unlimited PTO
Generous parental leave
Employer 401(k) match
Learning and wellness stipend
Health insurance for employees and dep
Remote-first policy with Manhattan in‑

Job summary

zipcolimited is seeking a senior software engineer to build production-grade AI systems, focusing on the decision and orchestration layer that guides AI task execution. The role spans customer-facing AI experiences and internal agent workflows in a financially regulated setting, with remote-first policy for US-based employees and an option to work from a Manhattan office.

Responsibilities include designing routing logic, implementing intent classification, benchmarking approaches, and building

Qualifications

  • 10+ years of professional software engineering experience.
  • Proficiency in Python or TypeScript with API design and automated testing.
  • Experience with LLM tool calling, structured outputs, retrieval-augmented generation, and agent/workflow orchestration.

Responsibilities

  • Design the routing layer to decide whether requests are handled by deterministic logic, retrieval, a classifier, a smaller or reasoning model, a tool call, or human escalation.
  • Build intent classification and clarification flows, evaluate confidence, and identify ambiguous input per task.
  • Benchmark rules, retrieval approaches, and models using quality, latency, safety, and cost metrics to guide selection.
  • Implement model adapters, structured outputs, timeouts, retry strategies, and fallback behavior in a testable orchestration layer.
  • Connect agents to approved APIs and tools with authentication, authorization, policy checks, and idempotency.
  • Partner with security to implement input/output protections and prompt-injection defenses.
  • Develop reusable orchestration patterns and components to aid other teams.
  • Measure and improve AI behavior in production through structured evaluation.

Skills

Python
TypeScript
APIs
Automated testing
Distributed services
CI/CD
LLM tool calling
Agent orchestration
Security & IAM

Job description

zipcolimited is seeking a senior software engineer to build production-grade AI systems, focusing on the decision and orchestration layer that guides AI task execution. The role spans customer-facing AI experiences and internal agent workflows in a financially regulated setting, with remote-first policy for US-based employees and an option to work from a Manhattan office.

Responsibilities include designing routing logic, implementing intent classification, benchmarking approaches, and building

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Engineer - Remote-First, Production Orchestration
Senior AI Engineer - Remote-First, Production Orchestration

Quadpay, a Zip Company • United States

Remote
USD 162,000 - 205,000
Unlimited PTO
Parental leave
401k match
+2
Remote-First Senior AI Orchestration Engineer
Remote-First Senior AI Orchestration Engineer

Zip Co • United States

Remote
USD 162,000 - 205,000
Flexible working culture
Unlimited PTO
401k match
+2
Senior AI Agents Engineer (Remote • Equity)
Senior AI Agents Engineer (Remote • Equity)

People in AI • United States

Remote
USD 200,000 - 275,000
Senior AI Orchestrator - Model Selection & Routing
Senior AI Orchestrator - Model Selection & Routing

Zip Co Limited • United States

Remote
USD 162,000 - 205,000
Flexible working culture
Unlimited PTO
Company-sponsored 401k match
+3
Senior AI Platform Engineer - Remote Orchestration
Senior AI Platform Engineer - Remote Orchestration

Elios, Inc. • United States

Remote
USD 162,000 - 205,000
Senior AI Engineer - Model Selection and Orchestration
Senior AI Engineer - Model Selection and Orchestration

zipcolimited • United States

Remote
USD 162,000 - 205,000
Unlimited PTO
Generous parental leave
Employer 401(k) match
+3
Senior AI Agent Engineer - Remote, Enterprise Orchestration
Senior AI Agent Engineer - Remote, Enterprise Orchestration

Ethereum Technologies LLC • Charlotte (NC)

Remote
USD 83,000 - 110,000
Remote AI Agent Architect & Orchestration Engineer
Remote AI Agent Architect & Orchestration Engineer

BuildMatix • United States

Remote
USD 140,000 - 210,000
Senior AI Engineer — Agentic Orchestration (Remote)
Senior AI Engineer — Agentic Orchestration (Remote)

JFL Consulting, LLC • Springfield (VA)

Hybrid
USD 160,000 - 190,000
Salary $160k-$190k
100% employer-paid health premiums
Flexible Spending Accounts
+5
Senior AI Engineer: Production-Grade Agent Orchestration
Senior AI Engineer: Production-Grade Agent Orchestration

IntegrAI • United States

Remote
USD 140,000 - 190,000