Senior AI Platform Engineer - Agent Infrastructure

Harvey; California (MO); On-site; USD 231,000 - 340,000; Full time

Job summary

Harvey's AI Platform team is building the foundation for all products, focusing on model routing, context management, and evaluation. This is a rare chance to shape a growing platform in a high-stakes domain and work with a team that values ownership and rapid iteration.

You will own infrastructure for model integration, routing, and evals, and collaborate with product, engineering, PMs, and design to ship reliable, enterprise‑grade AI capabilities that scale with the company.

Qualifications

• 8+ years building backend systems with at least 1+ year in AI/ML engineering.
• Experience shipping multi-model AI systems in production.
• Familiarity with context management or memory systems in AI.
• Built internal platforms or SDKs adopted by teams.
• Strong design judgment and pragmatic shipping approach.
• Interest in agentic AI and reliable autonomous systems.

Responsibilities

• Design and build platform-level abstractions for Harvey’s agentic products.
• Own infrastructure for model integration, routing, and evaluation.
• Build evaluation frameworks to improve AI quality.
• Partner with product, engineering, PMs, and design to launch AI products.
• Evaluate and integrate latest advancements in AI and agentic systems.

Skills

Backend systems

AI/ML engineering

Multi-model AI

Context management

SDKs/platforms

Developer experience

Abstractions design

Agentic AI

Job description

Harvey's AI Platform team is building the foundation for all products, focusing on model routing, context management, and evaluation. This is a rare chance to shape a growing platform in a high-stakes domain and work with a team that values ownership and rapid iteration.

You will own infrastructure for model integration, routing, and evals, and collaborate with product, engineering, PMs, and design to ship reliable, enterprise‑grade AI capabilities that scale with the company.