Staff AI Platform Engineer — Backend Systems

Fdetimes; New York (NY); On-site; USD 231,000 - 340,000; Full time

Job summary

Harvey is building a leading AI platform for legal and professional services. We’re seeking a senior backend/AI leader to shape the infrastructure, model routing, and evaluation frameworks that power our autonomous agents.

Your work will define how Harvey deploys foundation models, manages context and memory, and delivers reliable, scalable AI features across products. You’ll own critical platform layers and ship impact at scale.

Qualifications

• 10+ years of experience building backend systems with a focus on AI/ML engineering.
• Experience shipping multi-model AI systems in production.
• Familiarity with context management, session state, or memory systems in AI.
• Proven track record of building internal platforms and SDKs adopted by engineers.
• Strong design judgment and pragmatic shipping approach.
• Excitement about agentic AI and reliable autonomous systems.
• Ownership mindset and ability to navigate ambiguity.
• Bonus: evaluation frameworks, agent/function-calling architectures, or legal/professional services domain exposure.

Responsibilities

• Design and build abstractions and platform-level systems for Harvey's agentic products.
• Own infrastructure for model integration, routing, and evaluation.
• Build evaluation frameworks and tooling used across teams.
• Partner with product engineering, PMs, and design to launch AI products.
• Evaluate, prototype, and integrate the latest advancements in AI and agentic systems.

Skills

Backend systems

AI/ML engineering

Technical leadership

Multi-model AI systems

Context management

SDKs / platform tooling

Abstractions design

Agentic AI

Ownership

Evaluation frameworks

Agent/function-calling architectures

Legal domain experience

Early-stage startups

Job description

Harvey is building a leading AI platform for legal and professional services. We’re seeking a senior backend/AI leader to shape the infrastructure, model routing, and evaluation frameworks that power our autonomous agents.

Your work will define how Harvey deploys foundation models, manages context and memory, and delivers reliable, scalable AI features across products. You’ll own critical platform layers and ship impact at scale.