Foundation Model Inference Engineering Manager

Databricks Inc.; Mountain View (CA); On-site; USD 190,000 - 261,000; Full time

Job summary

Databricks in Mountain View, California, is seeking an Engineering Manager for the Foundation Model Inference (FMAPI) organization. You will lead a team delivering scalable inference infrastructure for real-time and batch workloads, collaborating with product and engineering to ensure reliability and high performance.

This role requires strong leadership, deep expertise in distributed systems and AI infrastructure, and a proven track record delivering multi-quarter initiatives in a fast-moving

Qualifications

• Experience managing and growing high-performing software engineering teams.
• Strong technical judgment in distributed systems, platform infrastructure, AI/ML infrastructure, or large-scale backend services.
• A track record of delivering complex, multi-quarter engineering initiatives with high quality and predictable execution.
• Experience partnering effectively with product management and peer engineering teams to translate customer and business needs into roadmaps and shipped outcomes.
• Operational rigor, including experience with service health, incident response, postmortems, and continuous improvement.
• Excellent communication, coaching, and hiring skills.
• BS in Computer Science or related field.

Responsibilities

• Lead and grow a team of talented, product-minded infrastructure Engineers working on Foundation Model Inference and API; own the systems powering large-scale inference workloads for customers.
• Shape roadmap for real-time inference, provisioned throughput, and batch inference use cases.
• Partner closely with product and engineering leadership to deliver capabilities with reliability, quality, and service health.
• Build an inclusive, high-performing team that attracts, develops, and retains exceptional engineers.
• Maintain deep understanding of your team’s technical area and uphold a strong bar for architecture and operational excellence.

Skills

Team Leadership

Distributed Systems

AI/ML Infrastructure

Backend Services

Hiring & Coaching

Product Partnership

Communication

Education

BS in Computer Science

Job description

Databricks in Mountain View, California, is seeking an Engineering Manager for the Foundation Model Inference (FMAPI) organization. You will lead a team delivering scalable inference infrastructure for real-time and batch workloads, collaborating with product and engineering to ensure reliability and high performance.

This role requires strong leadership, deep expertise in distributed systems and AI infrastructure, and a proven track record delivering multi-quarter initiatives in a fast-moving