Platform & AI Clusters Lead — Scale & SRE

Hamilton Barnes Associates Limited; San Francisco (CA); On-site; USD 450,000 - 550,000; Full time

Job summary

A pioneering technology company in San Francisco is seeking a Head of Platform/AI Cluster Management to lead AI and platform initiatives. Responsibilities include overseeing scheduler management and optimizing performance across cross-functional teams. The ideal candidate should have extensive experience in cluster management, especially with Slurm and Kubernetes. This role offers a competitive salary of $500,000 gross per year.

Qualifications

• Deep expertise in cluster management and scheduling.
• Hands-on experience with orchestration platforms.
• Strong understanding of performance tuning and workload management.

Responsibilities

• Oversee the scheduler/runtime layer including multi-tenancy and GPU management.
• Lead cluster operations and incident response.
• Deliver platform services for reliable workload execution.
• Collaborate with infra and SRE teams to optimize efficiency.

Skills

Cluster management

Scheduling

Runtime environments

Slurm

Kubernetes

Ray

NCCL performance tuning

Workload isolation

Congestion management

Job description

A pioneering technology company in San Francisco is seeking a Head of Platform/AI Cluster Management to lead AI and platform initiatives. Responsibilities include overseeing scheduler management and optimizing performance across cross-functional teams. The ideal candidate should have extensive experience in cluster management, especially with Slurm and Kubernetes. This role offers a competitive salary of $500,000 gross per year.