Staff Software Engineer, AI Runtime - Scalable GPU Training

Databricks Inc.; Mountain View (CA); On-site; USD 190,000 - 265,000; Full time

Job summary

Databricks Inc. seeks a Staff Software Engineer to enhance and scale its AI Runtime platform for GPU training. The role involves driving architecture, solving complex training issues, and mentoring engineers.

Applicants should have 10+ years in distributed systems and experience with frameworks like PyTorch. A commitment to collaboration and communication across teams is essential. Local pay ranges from $190,000 to $265,000 USD.

Qualifications

• 10+ years of experience in large-scale distributed systems.
• Hands-on experience with distributed training frameworks.
• Strong understanding of training resilience patterns.

Responsibilities

• Drive architecture of AIR’s managed GPU training platform.
• Solve large-scale training problems and push GPU efficiency.
• Lead engineering efforts from design to production rollout.

Skills

Distributed training frameworks

GPU infrastructure

High-performance computing

Algorithms and data structures

Communication skills

Education

BS in Computer Science

MS or PhD preferred

Tools

PyTorch

DeepSpeed

FSDP

Megatron

Job description

Databricks Inc. seeks a Staff Software Engineer to enhance and scale its AI Runtime platform for GPU training. The role involves driving architecture, solving complex training issues, and mentoring engineers.

Applicants should have 10+ years in distributed systems and experience with frameworks like PyTorch. A commitment to collaboration and communication across teams is essential. Local pay ranges from $190,000 to $265,000 USD.