Senior AI Platform Engineer — Build Next-Gen Agentic AI

Harvey, Inc.; New York (NY); Hybrid; USD 193,000 - 290,000; Full time

Job summary

Harvey, Inc. is building a pioneering AI platform for professional services in the United States. The AI Platform team develops foundation model routing, context management, and evaluation infrastructure to power Harvey's agents.

You will design platform-level abstractions, own model integration, and evaluation tooling, enabling rapid deployment of reliable AI features across products. Candidates bring 5+ years of backend experience and 1+ year in AI/ML, with a track record of shipping internal

Qualifications

• 5+ years of experience building backend systems with at least 1+ year focused on AI/ML engineering.
• Staff candidates typically have 8+ years and a track record of technical leadership across teams.
• Experience building and shipping multi-model or multi-provider AI systems in production.
• Familiarity with context management, session state, or memory systems in AI or distributed systems.
• Built internal platforms, SDKs, or shared infrastructure that teams adopted; understands developer experience matters.

Responsibilities

• Design and build abstractions and platform-level systems that improve Harvey's agentic products.
• Own infrastructure for model integration, routing, and evaluation that helps Harvey choose and deploy foundation models.
• Build evaluation frameworks and tooling that let every team iterate on AI quality effectively.
• Partner closely with product engineering teams, PMs, and design to launch cutting-edge AI products.
• Evaluate, prototype, and integrate the latest advancements in AI and agentic systems as they emerge.

Skills

Backend systems

AI/ML engineering

Multi-model AI

Context management

SDKs

Developer experience

Technical leadership

Job description

Harvey, Inc. is building a pioneering AI platform for professional services in the United States. The AI Platform team develops foundation model routing, context management, and evaluation infrastructure to power Harvey's agents.

You will design platform-level abstractions, own model integration, and evaluation tooling, enabling rapid deployment of reliable AI features across products. Candidates bring 5+ years of backend experience and 1+ year in AI/ML, with a track record of shipping internal