Senior Software Engineer, AI Runtime — GPU Training & Equity

Databricks Inc.; San Francisco (CA); On-site; USD 160,000 - 225,000; Full time

Job summary

Databricks is hiring a Senior Software Engineer to work on the AI Runtime platform, focusing on the systems behind GPU training and scalable training infrastructure. You will help shape features from design through production, improving reliability and developer experience for large-scale experiments.

The role emphasizes ownership of complex features, collaboration with researchers and customers, and efforts to optimize performance across GPU architectures.

Qualifications

• 5+ years in large-scale distributed systems.
• Experience training large models with FSDP, DeepSpeed, or Megatron.
• Familiarity with parallelism strategies and GPU performance.
• Strong understanding of training resilience patterns (checkpointing, failure detection).
• Experience building and running multi-tenant cloud platforms as products.
• Proven track record of owning complex features end to end with customer impact.
• Ability to explain technical designs in writing and speech.

Responsibilities

• Build core parts of AI Runtime and contribute to Databricks' technical direction in AI training infrastructure.
• Develop reliability and observability features for a growing fleet.
• Improve AI Runtime's developer experience for large training jobs.
• Prepare AI Runtime for new GPU generations and workload types.
• Tackle multi-node training challenges including orchestration and data loading.
• Improve training speed and cost efficiency across architectures and GPUs.
• Collaborate with research, product, and customers from design to production.
• Champion engineering excellence and mentor teammates.

Skills

Distributed systems

GPU training / ML systems

Parallelism strategies

Resilience & checkpointing

End-to-end ownership

Technical writing & communication

Education

BS in Computer Science or related field

MS or PhD preferred

Job description

Databricks is hiring a Senior Software Engineer to work on the AI Runtime platform, focusing on the systems behind GPU training and scalable training infrastructure. You will help shape features from design through production, improving reliability and developer experience for large-scale experiments.

The role emphasizes ownership of complex features, collaboration with researchers and customers, and efforts to optimize performance across GPU architectures.