Senior AI Orchestration Engineer — Remote, PTO & Equity

zipcolimited; United States; Remote; USD 162,000 - 205,000; Full time

Benefits offered by this job

Unlimited PTO

Parental leave

Retirement plan

Learning stipend

Wellness stipend

Insurance coverage

Job summary

zipcolimited is seeking a senior engineer to build production-grade AI systems, focusing on orchestration and decision layers across customer-facing experiences and internal workflows. The role is remote-first for US-based employees, with an option to work in-person from a Manhattan office.

You will design routing, classification, model adapters, and secure API integrations, emphasizing reliability, security, and strong engineering judgment.

Qualifications

• 10+ years of professional experience delivering production software with AI or ML-enabled apps.
• Proficiency in Python or TypeScript with API design and automated testing.
• Experience with LLM tool calling, structured outputs, retrieval-augmented generation.
• Ability to evaluate model quality, uncertainty, fallback strategies, and different approaches by measurable outcomes.
• Experience with cloud deployment, CI/CD, observability, IAM, secrets management, retries, idempotency, and failure recovery.
• Sound judgment on when to use deterministic software, retrieval, a model, or a combination, and when to involve a human.

Responsibilities

• Design and implement the routing layer for task execution paths across deterministic logic, retrieval, classifiers, smaller or reasoning models, tool calls, or human escalation.
• Build intent classification and clarification flows to distinguish information requests from actions.
• Benchmark rules, retrieval approaches, and models using quality, latency, safety, and cost metrics.
• Implement model adapters, structured outputs, timeouts, retry strategies, and fallback behavior in a testable orchestration layer.
• Connect agents to approved APIs and tools with authentication, policy checks, and recovery for state-changing actions.
• Collaborate with security to implement protections for input/output and sensitive data handling.
• Develop reusable orchestration patterns and components for AI-powered experiences.
• Measure and improve AI behavior in production through structured evaluation.

Skills

Python

TypeScript

APIs & Testing

Distributed systems

LLM tool calling

CI/CD

Tools

AWS

CI/CD tools

Observability tooling

Secrets management

Job description

zipcolimited is seeking a senior engineer to build production-grade AI systems, focusing on orchestration and decision layers across customer-facing experiences and internal workflows. The role is remote-first for US-based employees, with an option to work in-person from a Manhattan office.

You will design routing, classification, model adapters, and secure API integrations, emphasizing reliability, security, and strong engineering judgment.