Senior Staff AI Runtime Architect (GPU Training)

Databricks Inc.; Mountain View (CA); On-site; USD 229,000 - 343,000; Full time

Job summary

Databricks is seeking a Senior Staff Software Engineer to tackle the systems behind AI Runtime, a serverless platform that makes large-scale GPU training practical for enterprises.

You will drive architecture, reliability, and developer experience, mentor engineers, and collaborate with research, product, and customers to shape future features across multi-node training, GPUs, and accelerator workloads.

Qualifications

• Extensive experience in large-scale distributed systems.
• Hands-on with GPU training frameworks (FSDP, DeepSpeed or Megatron).
• Proven track record of setting technical direction across teams.
• Experience building multi-tenant cloud platforms as products.

Responsibilities

• Drive AI Runtime architecture and long-term technical direction.
• Define reliability and observability strategy for a growing fleet.
• Shape developer experience for large training jobs to be as simple as a first experiment.
• Collaborate with research, product and customers to decide what to build next.

Skills

Large-scale distributed systems

GPU training

FSDP/DeepSpeed/Megatron

GPU performance

Checkpointing

Multi-tenant cloud platforms

Technical leadership

Mentoring engineers

Education

BS in Computer Science or related field

MS or PhD preferred

Job description

Databricks is seeking a Senior Staff Software Engineer to tackle the systems behind AI Runtime, a serverless platform that makes large-scale GPU training practical for enterprises.

You will drive architecture, reliability, and developer experience, mentor engineers, and collaborate with research, product, and customers to shape future features across multi-node training, GPUs, and accelerator workloads.