Senior AI Infrastructure Engineer: Scalable LLM Platforms

Databricks; California (MO); On-site; USD 190,000 - 265,000; Full time

Job summary

Databricks is seeking backend engineers to help build the FMAPI platform, powering large-language-model inference at enterprise scale. You will contribute to scalable, real-time AI services and collaborate across platform, infra, and ML teams.

This role emphasizes ownership, reliability, and performance in a fast-moving AI infrastructure environment. You will join a high-visibility team shaping the data and AI platform used by thousands of customers, with opportunities to influence roadmap and

Qualifications

• 8+ years of backend or infrastructure engineering experience.
• Experience with distributed systems, scalable APIs, or cloud-native infrastructure.
• Strong product ownership mindset and shipping user-facing value.
• Experience with real-time serving, ML infrastructure, or GPU orchestration.
• Familiarity with service-oriented architecture, deployment pipelines, and observability.
• Strong programming skills in Scala, Go, or Python.

Responsibilities

• Build LLM infrastructure powering large-scale inference workloads for customers via partner models and self-hosted models.
• Shape the FMAPI product direction from roadmap to execution through deep customer empathy with enterprise users and providers.
• Improve reliability, latency, and efficiency of distributed AI workloads.
• Collaborate with platform, infra, and ML teams to deliver end-to-end experiences.
• Define how developers and data scientists build and interact with AI on Databricks.

Skills

LLM infrastructure

Distributed systems

Cloud-native infra

Product ownership

Real-time serving

GPU orchestration

Scala Go Python

Job description

Databricks is seeking backend engineers to help build the FMAPI platform, powering large-language-model inference at enterprise scale. You will contribute to scalable, real-time AI services and collaborate across platform, infra, and ML teams.

This role emphasizes ownership, reliability, and performance in a fast-moving AI infrastructure environment. You will join a high-visibility team shaping the data and AI platform used by thousands of customers, with opportunities to influence roadmap and