AI Infrastructure Engineering Manager, Foundation Models

Menlo Ventures

Mountain View (CA)

On-site

USD 190,000 - 261,250

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Databricks, a leading data and AI company, seeks an Engineering Manager to lead the Foundation Model Inference team. You will guide infra engineers, drive multi-quarter initiatives, and collaborate with product leaders to deliver reliable, scalable AI capabilities.

The role emphasizes strong architectural judgment, team growth, and operational excellence in a fast-paced AI infrastructure environment.

Qualifications

  • Experience managing and growing high-performing software engineering teams.
  • Strong technical judgment in distributed systems, platform infrastructure, AI/ML infrastructure, or large-scale backend services.
  • Track record delivering complex, multi-quarter engineering initiatives with high quality and predictable execution.
  • Experience partnering effectively with product management and peer engineering teams to translate customer and business needs into roadmaps and shipped outcomes.
  • Operational rigor, including incident response, postmortems, and continuous improvement.
  • Excellent communication, coaching, and hiring skills.
  • BS in Computer Science or related field.

Responsibilities

  • Lead and grow a team of infrastructure engineers for Foundation Model Inference and Foundation Model API.
  • Shape roadmaps for real-time inference, provisioned throughput, and batch inference use cases.
  • Partner with product and engineering leadership to deliver capabilities with reliability and service health.
  • Maintain a deep understanding of the team's technical area and uphold high architectural and execution standards.

Skills

Leadership
Distributed systems
AI/ML infrastructure
Backend services
Product collaboration
Operational rigor
Communication & hiring

Education

BS in Computer Science or related field

Job description

Databricks, a leading data and AI company, seeks an Engineering Manager to lead the Foundation Model Inference team. You will guide infra engineers, drive multi-quarter initiatives, and collaborate with product leaders to deliver reliable, scalable AI capabilities.

The role emphasizes strong architectural judgment, team growth, and operational excellence in a fast-paced AI infrastructure environment.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Engineering Manager: Foundation Model Inference Leader
Engineering Manager: Foundation Model Inference Leader

Databricks • San Francisco (CA)

On-site
USD 190,000 - 262,000
Engineering Manager, Foundation Model Inference
Engineering Manager, Foundation Model Inference

Neura Market • Mountain View (CA)

Hybrid
USD 190,000 - 261,000
Foundation Model Inference Engineering Manager
Foundation Model Inference Engineering Manager

Databricks Inc. • Mountain View (CA)

On-site
USD 190,000 - 261,000
Staff AI Platform Engineer - Foundation Model Inference
Staff AI Platform Engineer - Foundation Model Inference

Doist • San Francisco (CA), Northern (KY)

Hybrid
USD 190,000 - 265,000
Staff AI Infra Engineer, Foundation Model Inference
Staff AI Infra Engineer, Foundation Model Inference

Menlo Ventures • San Francisco (CA)

On-site
USD 190,000 - 265,000
Staff Software Engineer - Foundation Model API & Infra
Staff Software Engineer - Foundation Model API & Infra

Neura Market • San Francisco (CA), Northern (KY)

Hybrid
USD 192,000 - 260,000
Staff Engineer, Foundation Models & AI Infrastructure
Staff Engineer, Foundation Models & AI Infrastructure

Databricks • San Francisco (CA)

On-site
USD 190,000 - 265,000
Staff Software Engineer, Foundation Model API – AI Infra Lead
Staff Software Engineer, Foundation Model API – AI Infra Lead

Neura Market • San Francisco (CA), Northern (KY)

Hybrid
USD 190,000 - 265,000
Senior AI Infra Engineer — Inference Platform
Senior AI Infra Engineer — Inference Platform

Databricks Inc. • San Francisco (CA)

On-site
USD 190,000 - 265,000
Engineering Manager, Foundation Model Inference (FMAPI)
Engineering Manager, Foundation Model Inference (FMAPI)

Databricks • Mountain View (CA)

On-site
USD 190,000 - 261,000