Staff Platform Infrastructure Engineer – Scalable AI Cloud

Anyscale

San Francisco (CA)

On-site

USD 260,000 - 380,000

Full time

7 days ago

Be an early applicant

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Benefits offered by this job

Competitive salary and equity

Health/dental/vision coverage

Flexible time off

Paid parental leave

Mental health support

Job summary

Anyscale in San Francisco seeks a Staff Software Engineer to lead the infrastructure team's technical vision. You will shape the control plane and data plane to scale the Ray-based platform across cloud and on‑prem environments, defining standards for reliability and performance.

Bring 5+ years in distributed systems, deep Go and Python, and a proven ability to mentor senior engineers and influence architecture without direct authority.

Qualifications

5+ years writing production code and leading distributed systems projects.
Cloud-native platform design for AWS/Azure/GCP.
Deep Kubernetes deployment expertise at large scale.
Go and Python mastery; set coding standards.

Responsibilities

Define multi-year technical roadmap for Ray cluster orchestration.
Design high-performance control plane components for AI workloads.
Set reliability, scalability, and observability standards for infrastructure.
Drive accelerator integration (GPUs/TPUs) and container management.
Lead architecture discussions and reduce technical debt.
Collaborate with ML experts and customer teams to meet needs.

Skills

Distributed systems

Kubernetes

Linux fundamentals

Go & Python

Leadership

Job description

Bring 5+ years in distributed systems, deep Go and Python, and a proven ability to mentor senior engineers and influence architecture without direct authority.

Get your free, confidential resume review.

or drag and drop your file here.