Staff AI Platform Engineer (Backend & Infra)

Harvey, Inc.; New York (NY); Hybrid; USD 231,000 - 340,000; Full time

Job summary

Harvey is building a next-generation AI-powered platform for legal and professional services, with a strong focus on agentic AI infrastructure. The role focuses on backend, platform abstractions, and scalable AI pipelines to support multiple foundation models and evaluation workflows.

You will own model integration, routing, and evaluation, working closely with product teams to ship reliable, high-quality AI features. A track record of leadership and delivering at scale is essential.

Qualifications

• 8+ years building backend systems.
• Experience shipping multi-model AI systems in production.
• Familiarity with context management, session state, or memory systems.

Responsibilities

• Design and build platform-level abstractions and systems for Harvey’s agentic products.
• Own infrastructure for model integration, routing, and evaluation to select and deploy foundation models.
• Build evaluation frameworks and tooling to iterate on AI quality across teams.
• Partner with product engineering, PMs, and design to launch AI products.
• Evaluate and integrate latest advancements in AI and agentic systems.

Skills

Backend systems

AI/ML engineering

Technical leadership

Multi-model AI

Context management

Tools

SDKs

Job description

Harvey is building a next-generation AI-powered platform for legal and professional services, with a strong focus on agentic AI infrastructure. The role focuses on backend, platform abstractions, and scalable AI pipelines to support multiple foundation models and evaluation workflows.

You will own model integration, routing, and evaluation, working closely with product teams to ship reliable, high-quality AI features. A track record of leadership and delivering at scale is essential.