Engineering Manager, Foundation Model Inference

Neura Market; Mountain View (CA); Hybrid; USD 190,000 - 261,000; Full time

Job summary

Databricks in Mountain View is seeking an Engineering Manager to lead the Foundation Model Inference (FMAPI) organization. You will build and guide teams responsible for large-scale inference workloads, partnering with product to deliver reliable, scalable AI infrastructure.

You will shape multi-quarter roadmaps, uphold technical excellence, and hire and develop engineers to advance enterprise-grade AI capabilities across real-time and batch inference use cases.

Qualifications

• Experience leading high-performing software teams.
• Strong judgment in distributed systems and backend infrastructure.
• Proven track record delivering multi-quarter initiatives.
• Ability to translate customer needs into roadmaps with product peers.
• Experience with incident response and postmortems.
• Excellent communication and hiring skills.
• BS in Computer Science or related field.

Responsibilities

• Lead and grow the Foundation Model Inference engineering teams.
• Shape roadmap for real-time and batch inference capabilities.
• Collaborate with product and engineering leadership to deliver reliable features.
• Maintain architectural quality and operational excellence.
• Foster inclusive, high-performing team culture.

Skills

Team leadership

Distributed systems

AI/ML infrastructure

Software architecture

Hiring and coaching

Education

BS in Computer Science or related field

Job description

Databricks in Mountain View is seeking an Engineering Manager to lead the Foundation Model Inference (FMAPI) organization. You will build and guide teams responsible for large-scale inference workloads, partnering with product to deliver reliable, scalable AI infrastructure.

You will shape multi-quarter roadmaps, uphold technical excellence, and hire and develop engineers to advance enterprise-grade AI capabilities across real-time and batch inference use cases.