Senior AI Platform Engineer - Agent Infrastructure

Harvey, Inc.; San Francisco, Northern (CA, KY); Hybrid; USD 220,000 - 300,000; Full time

Job summary

Harvey, Inc. in San Francisco is seeking a senior AI Platform Engineer who will shape the foundation of our agentic AI products. You’ll own the infrastructure for model integration, routing, and evaluation to ensure reliable, scalable performance.

Join a team that designs context management, memory, and SDKs used across Harvey’s product suites. You’ll lead with strong judgment, ship incrementally, and continuously raise the bar for AI quality in high-stakes environments.

Qualifications

• 5+ years of backend systems experience with a focus on AI/ML engineering.
• Experience shipping multi-model AI systems in production.
• Familiarity with context management, session state, or memory in AI or distributed systems.
• Track record building internal platforms, SDKs, or shared infrastructure used by other teams.
• Strong design judgment and pragmatic shipping, incrementally.

Responsibilities

• Design and build platform-level abstractions for Harvey’s AI products.
• Own infrastructure for model integration, routing, and evaluation across tasks.
• Build evaluation frameworks to improve AI quality across teams.
• Collaborate with product, engineering, PMs, and design to launch cutting-edge AI products.
• Evaluate and prototype latest advancements in agentic AI systems.

Skills

Backend systems

AI/ML engineering

Technical leadership

Context management

Agentic AI

Job description

Harvey, Inc. in San Francisco is seeking a senior AI Platform Engineer who will shape the foundation of our agentic AI products. You’ll own the infrastructure for model integration, routing, and evaluation to ensure reliable, scalable performance.

Join a team that designs context management, memory, and SDKs used across Harvey’s product suites. You’ll lead with strong judgment, ship incrementally, and continuously raise the bar for AI quality in high-stakes environments.