Senior AI Infra Engineer — Inference Platform

Databricks Inc.; San Francisco (CA); On-site; USD 190,000 - 265,000; Full time

Job summary

Databricks is seeking high-agency engineers to power model inference at enterprise scale. You will build and operate infrastructure that enables serving, scaling, and optimizing frontier models with enterprise reliability.

You will collaborate across platform, infra, and ML teams to deliver seamless end-to-end experiences for data scientists and developers building AI applications on Databricks. This role offers exposure to cutting-edge AI infrastructure and scalable systems across production

Qualifications

• 8+ years of experience in backend or infrastructure engineering.
• Experience with distributed systems, scalable APIs, or cloud-native infrastructure.
• Familiarity with real-time serving, ML infrastructure, or GPU orchestration.

Responsibilities

• Build and maintain LLM infrastructure powering large-scale inference workloads.
• Improve reliability, latency, and efficiency of distributed AI workloads.
• Collaborate with platform, infra, and ML teams to deliver end-to-end experiences.
• Shape how developers and data scientists build and interact with AI on Databricks.

Skills

Backend engineering

Distributed systems

Cloud-native

APIs

ML infrastructure

GPU orchestration

Observability

SOA

Tools

SageMaker

Vertex AI

Azure ML

MLflow

PyTorch

Ray

vLLM

SGLang

Job description

Databricks is seeking high-agency engineers to power model inference at enterprise scale. You will build and operate infrastructure that enables serving, scaling, and optimizing frontier models with enterprise reliability.

You will collaborate across platform, infra, and ML teams to deliver seamless end-to-end experiences for data scientists and developers building AI applications on Databricks. This role offers exposure to cutting-edge AI infrastructure and scalable systems across production