Site Reliability Engineer, Cloud Infra for AI Platform

Anyscale; San Francisco (CA); On-site; USD 150,000 - 210,000; Full time

Job summary

Anyscale in San Francisco, CA is seeking a Site Reliability Engineer to join the Infrastructure team. You will design and build the scalable control and data plane that powers distributed AI workloads across cloud and on‑prem environments.

The role emphasizes Kubernetes, cloud-native infrastructure, Go and Python, with on‑call responsibilities and collaboration with field teams to deliver high‑availability systems for Ray workloads.

Qualifications

• Bachelor's degree in CS or equivalent.
• 3+ years of production code experience.
• Experience building scalable distributed systems.
• Proficiency with Go and Python.
• Deep understanding of cloud-native infrastructures and Kubernetes.
• Knowledge of networking, security, and auth in cloud environments.
• Experience with observability stacks (Prometheus, Grafana).

Responsibilities

• Design and build scalable control and data plane components for Ray-based workloads.
• Scale services across cloud and on-prem environments (VM and Kubernetes).
• Develop intelligent scheduling and resource management.
• Improve reliability, performance, and observability.
• Provide on-call support and collaborate with customers.

Skills

Go

Python

Distributed systems

Cloud-native

Networking

Observability stacks

Education

Bachelor's degree in Computer Science or equivalent

Tools

Kubernetes

AWS

Azure

GCP

Linux

Prometheus

Grafana

Job description

Anyscale in San Francisco, CA is seeking a Site Reliability Engineer to join the Infrastructure team. You will design and build the scalable control and data plane that powers distributed AI workloads across cloud and on‑prem environments.

The role emphasizes Kubernetes, cloud-native infrastructure, Go and Python, with on‑call responsibilities and collaboration with field teams to deliver high‑availability systems for Ray workloads.