Senior AI Training Systems Architect

Databricks Inc.; Mountain View (WY); On-site; USD 229,000 - 343,000; Full time

Job summary

Databricks Inc. is seeking a Senior Staff Software Engineer to lead AI Runtime infrastructure, focusing on scalable GPU training and multi-node orchestration. You will shape architecture, reliability, and developer experience for the next generation of large-scale training jobs.

You will mentor engineers, collaborate with research and product teams, and help the company optimize training speed and cost across models and hardware generations.

Qualifications

• 15+ years in large-scale distributed systems.
• Experience training large models with parallelism frameworks.
• Expertise in GPU performance and accelerator architectures.
• Experience building multi-tenant cloud platforms.
• Track record of setting technical direction across teams.

Responsibilities

• Drive AI Runtime's architecture and long-term technical direction.
• Define reliability and observability strategy for a growing fleet.
• Shape developer experience for large training jobs.

Skills

Distributed systems

GPU training

Parallelism strategies

Multi-node training

Mentoring / leadership

System reliability

Observability

Education

BS in Computer Science or related field

MS/PhD preferred

Tools

FSDP

DeepSpeed

Megatron

Job description

Databricks Inc. is seeking a Senior Staff Software Engineer to lead AI Runtime infrastructure, focusing on scalable GPU training and multi-node orchestration. You will shape architecture, reliability, and developer experience for the next generation of large-scale training jobs.

You will mentor engineers, collaborate with research and product teams, and help the company optimize training speed and cost across models and hardware generations.