Cluster Infrastructure Engineer - Kubernetes & AI Compute

Sail Research; San Francisco (CA); On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

SF office

Free meals

Studio Display at desk

Job summary

Sail Research is building the world’s most efficient software for inference and agent hosting, with a focus on scalable cluster infrastructure. You’ll join as an early engineer on Clusters, writing code to provision and manage large fleets of compute across clouds.

You’ll design and implement highly available systems and scheduling to maximize GPU utilization, while steering future directions for autonomous remediation and self-serve ops.

Qualifications

• Deep understanding of Kubernetes and related technology.
• You take a product-focused approach to platform work and care deeply about building solutions that are robust, scalable, and ergonomic for users.

Responsibilities

• Build reliable systems that let us manage and share compute across clouds.
• Implement scheduling algorithms that maximize GPU utilization.
• Design highly-available systems that route around hardware faults and swap in hot spares to deliver users a pristine experience on unreliable hardware.
• Implement wraparound monitoring and alerting to ensure high availability.
• Own future directions for Clusters (autonomous remediation, self-serve ops, bare-metal provisioning, etc.).

Skills

Kubernetes

Cluster management

Tools

k3k

vCluster

Job description

Sail Research is building the world’s most efficient software for inference and agent hosting, with a focus on scalable cluster infrastructure. You’ll join as an early engineer on Clusters, writing code to provision and manage large fleets of compute across clouds.

You’ll design and implement highly available systems and scheduling to maximize GPU utilization, while steering future directions for autonomous remediation and self-serve ops.