Staff Engineer, Distributed AI Systems

SkyPilot Cloud Consulting Inc.; San Mateo (CA); Ibrido; USD 180.000 - 260.000; Tempo pieno

Vantaggi offerti da questo lavoro

Equity

Medical insurance

401(k) plan

Autonomy

Open-source startup culture

Team meals

Descrizione del lavoro

SkyPilot Cloud Consulting Inc. in San Mateo, CA, seeks an engineer to own SkyPilot’s core distributed control plane, running AI workloads across clouds, Kubernetes, Slurm, and on-prem.

You will define direction, build robust features, and ensure reliability for frontier AI workloads. You will design, implement, and operate distributed systems at scale, work with users, and contribute to open-source infra projects.

Competenze

• Designed and operated distributed systems at production scale.
• Strong fundamentals in scheduling, state machines, coordination, and fault tolerance.
• Fluency in Python and Go with reasoning about concurrent, distributed code.
• Experience with multi-cloud environments and cloud control planes.

Mansioni

• Design and build the future of AI systems across distributed infra.
• Shape the technical direction of SkyPilot, defining modules and interfaces.
• Develop enhancements and new components for broader AI/workloads support.
• Engage with users and contribute to open-source tutorials/blogs/talks.

Conoscenze

Distributed systems design

Python/Go proficiency

Concurrency reasoning

Problem solving

Cloud/multi-cloud experience

Strumenti

Kubernetes internals

Cloud provider control planes (AWS/GCP/Azure)

Open-source AI infra contributions (KAI, KubeRay, Kueue, KServe)

Distributed scheduling mechanisms

Descrizione del lavoro

SkyPilot Cloud Consulting Inc. in San Mateo, CA, seeks an engineer to own SkyPilot’s core distributed control plane, running AI workloads across clouds, Kubernetes, Slurm, and on-prem.

You will define direction, build robust features, and ensure reliability for frontier AI workloads. You will design, implement, and operate distributed systems at scale, work with users, and contribute to open-source infra projects.