Engineering Manager, AI Platform & Model Infrastructure

Harvey; San Francisco (CA); Hybrid; USD 260,000 - 350,000; Full time

Job summary

Harvey, based in San Francisco, is building a next-generation AI-enabled professional services platform. As Engineering Manager for Model Infrastructure, you will lead a team of engineers responsible for scalable, reliable AI model provisioning, capacity management, failure handling, and cross-provider integration.

You will partner with AI Research, Product Engineering, Infrastructure, and external providers to ensure reliability, scalability, and cost efficiency as Harvey grows.

Qualifications

• 8+ years of software engineering experience with multiple years in people leadership.
• Experience leading teams for large-scale distributed systems or cloud infrastructure.
• Strong architectural and mentoring capabilities for senior engineers.
• Proven track record of building reliable production services with high availability.
• Experience building scalable platforms with observability, automation, and cost optimization.
• Excellent cross-functional leadership across Engineering, Research, Product, and vendors.

Responsibilities

• Lead and grow the Model Infrastructure team.
• Define the technical roadmap for reliability, scalability, and operational excellence.
• Build systems for provisioning, capacity management, failover, and incident response across providers.
• Own multi-provider platform integrations, SDK upgrades, API migrations, and onboarding new providers.
• Drive evolution of Unified Model Controller and Model Selector to route traffic by health, latency, and cost.
• Improve observability through dashboards, alerting, and end-to-end telemetry.

Skills

Team leadership

Distributed systems

Cloud infrastructure

Architectural guidance

Observability

Cross-functional collaboration

Effective communication

Talent development

Tools

Kubernetes

Cloud platforms

Spark

Kafka

Job description

Harvey, based in San Francisco, is building a next-generation AI-enabled professional services platform. As Engineering Manager for Model Infrastructure, you will lead a team of engineers responsible for scalable, reliable AI model provisioning, capacity management, failure handling, and cross-provider integration.

You will partner with AI Research, Product Engineering, Infrastructure, and external providers to ensure reliability, scalability, and cost efficiency as Harvey grows.