Engineering Manager, AI Model Infrastructure Platform

Harvey; California (MO); On-site; USD 260,000 - 340,000; Full time

Job summary

Harvey is building the next generation of AI-enabled professional services. We’re seeking an Engineering Manager for Model Infrastructure to lead a high-performing team responsible for the platform powering all model requests.

You’ll work with AI Research, Product Engineering, and external providers to ensure reliability, scalability, and cost efficiency as Harvey scales. The role offers the chance to shape Harvey’s technical foundation, grow a world-class engineering organization, and drive

Qualifications

• 8+ years of software engineering experience and leadership.
• Experience leading teams for large-scale distributed systems.
• Strong technical background to guide architecture and mentor engineers.
• Experience operating highly available production services with reliability.
• Experience building scalable, observable platforms with cost optimization.
• Strong cross-functional leadership and collaboration.
• Excellent communication and influence on technical strategy.
• Passion for building engineering teams and talent.

Responsibilities

• Lead and grow a high-performing team of engineers for Model Infrastructure.
• Define roadmap for reliability, scale, and operational excellence.
• Build reliable systems for provisioning, capacity, failover, and incident response across providers.
• Own multi-provider platform integrations, SDK upgrades, and migrations.
• Advance Unified Model Controller and Model Selector for health-based routing.
• Improve observability dashboards, alerting, and cost reporting.
• Partner with Product Engineering on launches, capacity planning, and monitoring.
• Drive efficiency in inference and reduce infrastructure costs across providers.
• Support training data pipelines and platform capabilities for future models.
• Collaborate with executives on AI infrastructure strategy and vendor relations.
• Recruit, mentor, and develop engineering talent.

Skills

8+ years engineering

Team leadership

Distributed systems

Cloud infrastructure

Communication

Cross-functional leadership

Mentorship

Strategic influence

Tools

Kubernetes

Spark

Kafka

Flink

Airflow

Iceberg

Job description

Harvey is building the next generation of AI-enabled professional services. We’re seeking an Engineering Manager for Model Infrastructure to lead a high-performing team responsible for the platform powering all model requests.

You’ll work with AI Research, Product Engineering, and external providers to ensure reliability, scalability, and cost efficiency as Harvey scales. The role offers the chance to shape Harvey’s technical foundation, grow a world-class engineering organization, and drive