Engineering Manager, Model Infrastructure

Harvey; San Francisco (CA); On-site; USD 272,000 - 355,000; Full time

Job summary

Harvey seeks an Engineering Manager for Model Infrastructure to lead the team powering model requests across Harvey. You will partner with AI Research, Product Engineering, Infrastructure, and external AI providers to ensure reliability, scalability, and cost efficiency as the business grows.

The role offers the chance to shape the technical foundation of Harvey's AI platform and to mentor a high-performing engineering organization while driving architectural excellence.

Qualifications

• 8+ years of software engineering experience with multiple years in people leadership.
• Proven ability to lead large-scale distributed systems or cloud infrastructure.
• Strong cross-functional leadership and communication to influence strategy across organizations.

Responsibilities

• Lead and grow a high-performing team of engineers for Harvey's Model Infrastructure platform.
• Define the technical roadmap for reliability, scalability, and operational excellence.
• Build reliable systems for model provisioning, capacity management, failover, and incident response across multiple AI providers.

Skills

Engineering leadership

Distributed systems

Cloud infrastructure

Observability

Cross-functional collaboration

Communication

Talent development

GPU/ML infra

Tools

Kubernetes

Cloud infrastructure

Telemetry platforms

LLM platforms

Job description

Harvey seeks an Engineering Manager for Model Infrastructure to lead the team powering model requests across Harvey. You will partner with AI Research, Product Engineering, Infrastructure, and external AI providers to ensure reliability, scalability, and cost efficiency as the business grows.

The role offers the chance to shape the technical foundation of Harvey's AI platform and to mentor a high-performing engineering organization while driving architectural excellence.