Staff AI Platform Engineer - Foundation & Agentic Systems

Harvey; New York (NY); On-site; USD 231,000 - 340,000; Full time

Job summary

Harvey is building AI-powered professional services platforms that scale agentic AI across legal workloads. The AI Platform team designs model routing, context management, and evaluation infrastructure to empower product teams.

You’ll own platform-level abstractions and collaborate with engineers, PMs, and designers to ship reliable, scalable AI features. Ideal candidates have 10+ years backend experience with AI/ML leadership, experience deploying multi-model AI systems, and a passion for

Qualifications

• 10+ years of experience building backend systems.
• At least 1+ year focused on AI/ML engineering and leadership across teams.
• Experience building and shipping multi-model AI systems in production.
• Familiarity with context management, session state, or memory in AI/distributed systems.
• Track record building internal platforms, SDKs, or shared infrastructure adopted by teams.
• Strong judgment about abstractions and pragmatic shipping.
• Passion for agentic AI and reliable autonomous systems.
• Bias toward ownership and solving problems without a roadmap.

Responsibilities

• Design and build abstractions and platform-level systems for Harvey’s agentic products.
• Own infrastructure for model integration, routing, and evaluation for foundation models.
• Build evaluation frameworks and tooling to iterate AI quality across teams.
• Partner with product, eng, PMs, and design to launch AI products.
• Evaluate and integrate latest advances in AI and agentic systems as they emerge.

Skills

Backend systems

AI/ML engineering

Technical leadership

Context management

Agentic AI

Job description

Harvey is building AI-powered professional services platforms that scale agentic AI across legal workloads. The AI Platform team designs model routing, context management, and evaluation infrastructure to empower product teams.

You’ll own platform-level abstractions and collaborate with engineers, PMs, and designers to ship reliable, scalable AI features. Ideal candidates have 10+ years backend experience with AI/ML leadership, experience deploying multi-model AI systems, and a passion for