Senior AI Runtime Systems Engineer - GPU Training

The Briefed; Mountain View (CA); On-site; USD 190,000 - 240,000; Full time

Benefits offered by this job

Equity grants

Bonus eligibility

Healthcare coverage

Paid time off

Retirement plans

Job summary

Databricks in Mountain View, CA, is seeking a Senior Software Engineer to join the AI Runtime team and work on core distributed systems behind a serverless GPU training platform.

You will tackle reliability, performance, and scalability across multi-tenant GPU clusters while mentoring teammates and collaborating with researchers, product management, and customers to deliver scalable AI infrastructure.

Qualifications

• 5+ years in large-scale distributed systems, GPU training, HPC or ML systems.
• Bachelor's in CS or related field; advanced degrees preferred.
• Experience with distributed parallelism frameworks and GPU performance.

Responsibilities

• Build core AI Runtime components and guide serverless GPU training infra.
• Improve reliability, observability for multi-tenant GPU clusters.
• Address multi-node training challenges including scheduling and data loading.
• Optimize performance and reduce compute costs across architectures and interconnects.
• Enhance developer and agent experience with robust tooling.
• Prepare AI Runtime for next-gen GPU hardware and accelerators.
• Own features end-to-end and mentor teammates from design to production.

Skills

Distributed systems

GPU training

Technical communication

Mentorship

Education

Bachelor's degree in Computer Science

Master's or PhD preferred

Tools

FSDP

DeepSpeed

Megatron

NVLink

InfiniBand

Job description

Databricks in Mountain View, CA, is seeking a Senior Software Engineer to join the AI Runtime team and work on core distributed systems behind a serverless GPU training platform.

You will tackle reliability, performance, and scalability across multi-tenant GPU clusters while mentoring teammates and collaborating with researchers, product management, and customers to deliver scalable AI infrastructure.