Senior AI Platform Engineer — Architect Agent Infrastructure

Harvey; California (MO); On-site; USD 220,000 - 300,000; Full time

Job summary

Harvey is building an AI platform foundation that powers agentic products for complex professional services. The role focuses on model routing, context management, and evaluation tooling to ensure high-quality AI outputs across teams.

You will own infrastructure for integrating foundation models, deploying them reliably, and contributing to developer-friendly platform primitives that accelerate product delivery.

Qualifications

• 5+ years of experience building backend systems.
• 1+ year focused on AI/ML engineering; staff may have 8+ years.
• Experience building multi-model or multi-provider AI systems in production.
• Familiarity with context management, session state, or memory in AI/distributed systems.
• Built internal platforms, SDKs, or shared infrastructure adopted by teams.

Responsibilities

• Design and build abstractions and platform-level systems for Harvey’s agentic products.
• Own infrastructure for model integration, routing, and evaluation across contexts.
• Build evaluation frameworks and tooling to measure AI quality across teams.
• Partner with product engineering, PMs, and design to launch cutting-edge AI products.
• Evaluate and integrate the latest advancements in AI and agentic systems.

Skills

Backend systems

AI/ML engineering

Technical leadership

Internal platforms

Distributed systems

Agentic AI

Tools

SDKs & developer tooling

Platform primitives

Job description

Harvey is building an AI platform foundation that powers agentic products for complex professional services. The role focuses on model routing, context management, and evaluation tooling to ensure high-quality AI outputs across teams.

You will own infrastructure for integrating foundation models, deploying them reliably, and contributing to developer-friendly platform primitives that accelerate product delivery.