Engineering Manager, AI Platform & Scale

Harvey AI; San Francisco (CA); On-site; USD 272,000 - 355,000; Full time

Job summary

Harvey AI is redefining how legal and professional services operate by building an enterprise-grade, AI-powered platform. As Engineering Manager for AI Platform, you will lead and scale a team building foundational systems powering Harvey’s AI across products, including model access, routing, orchestration, and observability.

You’ll partner with Product, Research, and engineering to translate cutting‑edge AI advances into durable platform capabilities and guide technical direction.

Qualifications

• 2+ years in a software engineering management role leading platform/infrastructure or full-stack product teams.
• 5+ years as backend, infrastructure, or full-stack engineer.
• Experience with production systems powered by LLMs (agents, retrieval, tool use, evaluation pipelines).

Responsibilities

• Lead and grow a team of engineers building Harvey's core AI platform.
• Define roadmap for shared AI infrastructure including model gateways, routing, agent orchestration, tool calling, and context management.
• Partner with Product, Research, and engineering to turn patterns into reusable platform primitives.
• Build/evolve evaluation, testing, and monitoring to measure quality and ship AI features.
• Drive reliability, latency, cost efficiency, and security across LLM-powered systems and model provider collaborations.
• Evaluate/adopt new models/frameworks and decide what to build vs buy.
• Contribute to code/architecture reviews and unblock teams.
• Hire, grow, and retain engineers in a high-trust, high-impact environment.

Skills

Leadership

Backend engineering

Python

Go

Node

LLMs

Infrastructure

Observability

Job description

Harvey AI is redefining how legal and professional services operate by building an enterprise-grade, AI-powered platform. As Engineering Manager for AI Platform, you will lead and scale a team building foundational systems powering Harvey’s AI across products, including model access, routing, orchestration, and observability.

You’ll partner with Product, Research, and engineering to translate cutting‑edge AI advances into durable platform capabilities and guide technical direction.