Senior AI Platform Engineer - Agentic Systems

Fdetimes; San Francisco (CA); On-site; USD 231,000 - 340,000; Full time

Job summary

Harvey is seeking an experienced backend/AI Platform engineer to shape the core AI foundation, including model routing, context management, and agent infrastructure. You will help define the ceiling of Harvey’s AI capabilities and ship platform-level systems.

You will collaborate with product engineering, PMs, and design to launch cutting-edge AI products, evaluate new foundation models, and build shared tooling. 10+ years backend and AI/ML leadership experience is expected.

Qualifications

• 10+ years of experience building backend systems with leadership in AI/ML
• Experience building and shipping multi-model AI systems in production
• Familiarity with context management, session state, or memory in AI or distributed systems
• Built internal platforms, SDKs, or shared infrastructure adopted by engineering teams
• Strong judgment on abstractions and pragmatic shipping

Responsibilities

• Design and build abstractions and platform-level systems that improve Harvey’s agentic products.
• Own infrastructure for model integration, routing, and evaluation that helps Harvey choose and deploy the right foundation model for any context.
• Build evaluation frameworks and tooling to let teams iterate on AI quality effectively.
• Partner with product engineering teams, PMs, and design to launch cutting-edge AI products.
• Evaluate, prototype, and integrate the latest advancements in AI and agentic systems as they emerge.

Skills

Backend systems

AI/ML engineering

Multi-model AI systems

Context management

Developer platforms / SDKs

Ownership/leadership

Agentic AI

Tools

SDKs

Distributed systems tooling

Eval frameworks

Job description

Harvey is seeking an experienced backend/AI Platform engineer to shape the core AI foundation, including model routing, context management, and agent infrastructure. You will help define the ceiling of Harvey’s AI capabilities and ship platform-level systems.

You will collaborate with product engineering, PMs, and design to launch cutting-edge AI products, evaluate new foundation models, and build shared tooling. 10+ years backend and AI/ML leadership experience is expected.