Staff Engineer, Foundation Model Inference & AI Infra

Fdetimes; San Francisco (CA); On-site; USD 190,000 - 265,000; Full time

Job summary

Databricks is seeking high-agency engineers to power model inference at enterprise scale. You will build platform infrastructure that enables scalable LLM APIs and integration with partner models, as well as self-hosted options.

This role emphasizes reliability, performance, and collaboration with cross-functional teams. You will contribute to AI products powering data apps, agents, and model serving at scale, with opportunities to influence enterprise-grade deployment and governance.

Qualifications

• 8+ years of experience in backend or infrastructure engineering.
• Experience with distributed systems, scalable APIs, or cloud-native infrastructure.
• Experience with real-time serving, ML infrastructure, or GPU orchestration.

Responsibilities

• Build LLM infrastructure powering large-scale inference workloads for customers through partner models and self-hosted models.
• Improve reliability, latency, and efficiency of distributed AI workloads.
• Collaborate with platform, infra, and ML teams to deliver seamless end-to-end experiences.
• Shape how developers and data scientists build and interact with AI on Databricks.

Skills

Backend engineering

Distributed systems

Real-time serving

Job description

Databricks is seeking high-agency engineers to power model inference at enterprise scale. You will build platform infrastructure that enables scalable LLM APIs and integration with partner models, as well as self-hosted options.

This role emphasizes reliability, performance, and collaboration with cross-functional teams. You will contribute to AI products powering data apps, agents, and model serving at scale, with opportunities to influence enterprise-grade deployment and governance.