Distributed AI Infra Engineer (Go/Python, Kubernetes)

Anyscale; Palo Alto, San Francisco (CA, CA); On-site; USD 150,000 - 210,000; Full time

Job summary

Anyscale in Palo Alto, CA seeks a Software Engineer to join the Infrastructure team to build the control and data planes powering Ray in the cloud. You will design scalable services, work across Kubernetes-based deployments, and collaborate with open-source Ray integration.

The role requires 3+ years of production-grade software experience, strong Go and Python skills, and a passion for reliable, high-performance distributed systems.

Qualifications

• 3+ years of production code experience.
• Experience building distributed systems and scalable services.
• Familiarity with cloud-native tech (AWS/Azure/GCP) and Kubernetes.

Responsibilities

• Design, build, and scale Ray cluster orchestration services across cloud/on-prem environments.
• Improve reliability, performance, and observability of infra components.
• Collaborate in code reviews, architecture discussions, and on-call support.

Skills

Go

Python

Kubernetes

Distributed systems

Cloud

Education

Bachelor's degree in Computer Science

Tools

Git

Prometheus

Grafana

Job description

Anyscale in Palo Alto, CA seeks a Software Engineer to join the Infrastructure team to build the control and data planes powering Ray in the cloud. You will design scalable services, work across Kubernetes-based deployments, and collaborate with open-source Ray integration.

The role requires 3+ years of production-grade software experience, strong Go and Python skills, and a passion for reliable, high-performance distributed systems.