Senior AI Training Systems Engineer

Databricks Inc.; Mountain View (CA); On-site; USD 190,000 - 265,000; Full time

Job summary

Databricks is the Data and AI company behind the Databricks Data + AI Platform. We run the world’s largest AI platform and offer AI Runtime to simplify GPU training for enterprise data.

Staff Software Engineers will tackle hard problems across AI training infrastructure and guide system-level decisions that scale with growing workloads. You will partner with research, product, and customers to shape what we build next and mentor engineers across teams, raising the bar for engineering excellence.

Qualifications

• 10+ years in large-scale distributed systems with GPU training focus.
• Hands-on experience training large models with parallelism strategies.
• Experience building multi-tenant cloud platforms as products.
• Track record leading technical projects across teams with customer impact.

Responsibilities

• Drive major parts of AI Runtime’s architecture and long-term direction.
• Design reliability and observability systems for scaling fleets.
• Improve developer experience for large training jobs.
• Lead multi-node training problems including orchestration and GPU scheduling.
• Make training faster and cheaper through efficiency improvements.
• Collaborate with research, product, and customers to shape future work.

Skills

10+ years distributed systems

GPGPU experience

Leadership

Mentorship

Education

BS in Computer Science or related field

MS or PhD preferred

Tools

FSDP

DeepSpeed

Megatron

Job description

Databricks is the Data and AI company behind the Databricks Data + AI Platform. We run the world’s largest AI platform and offer AI Runtime to simplify GPU training for enterprise data.

Staff Software Engineers will tackle hard problems across AI training infrastructure and guide system-level decisions that scale with growing workloads. You will partner with research, product, and customers to shape what we build next and mentor engineers across teams, raising the bar for engineering excellence.