Remote-First Senior AI Orchestration Engineer

Zip Co

United States

Remote

USD 162,000 - 205,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Flexible working culture
Unlimited PTO
401k match
Wellness stipend
Zip office accessibility

Job summary

Zip is seeking a Senior AI Engineer to turn rapidly evolving AI capabilities into dependable customer experiences and useful tools for internal teams. You will work in the AI Platforms team, building shared capabilities that support Zia and internal agents across Zip.

You’ll design the decision and orchestration layer that determines when to use deterministic logic, retrieval, a model, a tool call, or escalation, balancing quality, safety, latency, reliability, and cost.

Qualifications

  • Minimum of 10 years of related experience with a Bachelor’s degree; or 6 years and a Master’s degree; or a PhD with 3 years experience; or equivalent experience.
  • 10+ years building, testing, deploying, and operating production software including AI/ML-enabled applications.
  • Proficiency in Python or TypeScript and modern software practices (API design, testing, distributed services).
  • Hands-on experience with LLM tool calling, structured outputs, retrieval-augmented generation, and agent/workflow orchestration.

Responsibilities

  • Design and build the decision and orchestration layer to choose deterministic logic, retrieval, smaller models, tools, or human escalation.
  • Develop intent classification and clarification flows to resolve ambiguous requests.
  • Benchmark and select models based on task success, latency, and reliability metrics.
  • Implement reliable model orchestration with adapters, routing, timeouts, and retries.
  • Integrate models, APIs, and tools with proper authentication, authorization, and safety controls.
  • Collaborate with Security and Risk on data protections, prompt-injection defenses, and access controls.
  • Create reusable AI platform capabilities to aid domain engineering teams and agent builders.
  • Monitor production systems, evaluate failures, and continuously improve model selection and orchestration.

Skills

AI systems
Model orchestration
Tool calling
Retrieval augmented
Production software engineering
Python/TypeScript
Model evaluation/selection
CI/CD/Observability
Security & compliance

Education

Bachelor’s degree
Master’s degree
PhD

Tools

Google Cloud
Model Garden
Azure integrations

Job description

Zip is seeking a Senior AI Engineer to turn rapidly evolving AI capabilities into dependable customer experiences and useful tools for internal teams. You will work in the AI Platforms team, building shared capabilities that support Zia and internal agents across Zip.

You’ll design the decision and orchestration layer that determines when to use deterministic logic, retrieval, a model, a tool call, or escalation, balancing quality, safety, latency, reliability, and cost.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Engineer - Remote-First, Production Orchestration
Senior AI Engineer - Remote-First, Production Orchestration

Quadpay, a Zip Company • United States

Remote
USD 162,000 - 205,000
Unlimited PTO
Parental leave
401k match
+2
Senior AI Orchestration Engineer (Remote)
Senior AI Orchestration Engineer (Remote)

zipcolimited • United States

Remote
USD 162,000 - 205,000
Unlimited PTO
Generous parental leave
Employer 401(k) match
+3
Senior AI Orchestrator - Model Selection & Routing
Senior AI Orchestrator - Model Selection & Routing

Zip Co Limited • United States

Remote
USD 162,000 - 205,000
Flexible working culture
Unlimited PTO
Company-sponsored 401k match
+3
Senior Data Engineer - AI Platform (Remote)
Senior Data Engineer - AI Platform (Remote)

Quadpay, a Zip Company • United States

Hybrid
USD 134,000 - 200,000
Flexible working culture
Incentive programs
Unlimited PTO
+5
Senior Data Engineer, AI Platform & Analytics (Remote)
Senior Data Engineer, AI Platform & Analytics (Remote)

Zip Co • United States

Remote
USD 134,000 - 168,000
Flexible working culture
Incentive programs
Unlimited PTO
+6
Remote Senior AI Architect for Finance Tech & GenAI
Remote Senior AI Architect for Finance Tech & GenAI

ZipStaff Inc. • San Antonio (TX)

Remote
USD 180,000 - 280,000
Health Insurance
Dental Insurance
Vision Insurance
+3
Remote Senior AI Architect & Lead – GenAI, ML & Automation
Remote Senior AI Architect & Lead – GenAI, ML & Automation

ZipStaff Inc. • San Antonio (TX)

Remote
USD 165,000 - 248,000
Health Insurance.
Dental Insurance.
Vision Insurance.
+3
Principal AI Security Engineer — Remote-First
Principal AI Security Engineer — Remote-First

Quadpay, a Zip Company • United States

Hybrid
USD 203,000 - 254,000
Flexible working culture
Incentive programs
Unlimited PTO
+4
Head of AI Security Architecture (Remote-First)
Head of AI Security Architecture (Remote-First)

Royper Royco LLC • New York (NY)

Hybrid
USD 203,000 - 254,000
Flexible working culture
Unlimited PTO
401k match
+1
Remote Frontend Engineer for Scalable AI UI
Remote Frontend Engineer for Scalable AI UI

Zip • United States

Remote
USD 150,000 - 220,000
Start-up equity
Health, vision & dental coverage
Catered meals
+5