Senior Engineering Manager, AI Runtime & GPU Training

Databricks; Mountain View (WY); On-site; USD 229,000 - 297,000; Full time

Job summary

Databricks is seeking a Senior Engineering Manager to lead the team behind the AI Runtime (AIR) product, focusing on both the user-facing experience and the underlying infrastructure for GPU-based training at scale.

You will shape the architecture, drive the product roadmap, and collaborate across product, research, platform, and customers to deliver scalable, reliable training capabilities and strong customer outcomes.

Qualifications

• 8+ years of software engineering experience.
• 3+ years in engineering management.
• Experience building/operating GPU training infrastructure at scale.
• Familiarity with distributed training frameworks (PyTorch, DeepSpeed, Megatron-LM).
• Experience with parallelism strategies (FSDP, tensor/pipeline).
• Experience with training resilience patterns: checkpointing and recovery.
• Understanding GPU performance fundamentals (NCCL, interconnects, memory).
• Ownership of customer experience with clear SLAs.

Responsibilities

• Lead, mentor, and grow a high-performing engineering team responsible for the Custom Training product and its foundational infrastructure.
• Define and own the product and technical roadmap for AIR.
• Collaborate with product, research, platform, infrastructure, and customers to drive end-to-end delivery.
• Drive architectural decisions for managed GPU training at scale.
• Advocate for customer needs and translate into product impact.
• Build observability and reliability for long-running multi-node training jobs.
• Partner with recruiting to attract, hire, and develop top-tier engineering talent.

Skills

GPU training infra

Distributed training

PyTorch

DeepSpeed

Megatron-LM

FSDP

Tensor/pipeline parallelism

Cross-functional leadership

Communication

Education

BS/MS in Computer Science or Electrical Engineering

Tools

NCCL

Job description

Databricks is seeking a Senior Engineering Manager to lead the team behind the AI Runtime (AIR) product, focusing on both the user-facing experience and the underlying infrastructure for GPU-based training at scale.

You will shape the architecture, drive the product roadmap, and collaborate across product, research, platform, and customers to deliver scalable, reliable training capabilities and strong customer outcomes.