Staff Platform Infra Engineer: Scale AI with Kubernetes

Speedrun Talent Network; San Francisco, Northern (CA, KY); Hybrid; USD 180,000 - 260,000; Full time

Benefits offered by this job

Health insurance

Wellness programs

Flexible time off

Job summary

Anyscale is seeking a Staff Software Engineer to lead the technical vision for the Infrastructure team, driving architectural evolution of the control and data planes for Ray-based workloads.

You will mentor engineers, define cloud-native standards, and align Ray open-source with Anyscale products across diverse environments. This role emphasizes leadership and strong system foundations.

Qualifications

• 5+ years building production-grade distributed systems.
• Proven ability to design scalable, reliable cloud-native platforms.
• Strong knowledge of Kubernetes-based deployments at scale.
• Expertise in Go and Python with coding standards.
• Experience mentoring engineers and shaping technical direction.

Responsibilities

• Architect multi-year technical roadmap for Ray cluster services.
• Lead design and optimization of high-performance control plane components.
• Set reliability, scalability, and observability standards.
• Direct strategy for accelerator integration (GPUs/TPUs) and containers.
• Lead architecture discussions and manage technical debt.

Skills

Distributed systems

Leadership

Kubernetes

Go

Python

Cloud platforms

Education

Bachelor's degree in CS or related field

Tools

AWS

Azure

GCP

Job description

Anyscale is seeking a Staff Software Engineer to lead the technical vision for the Infrastructure team, driving architectural evolution of the control and data planes for Ray-based workloads.

You will mentor engineers, define cloud-native standards, and align Ray open-source with Anyscale products across diverse environments. This role emphasizes leadership and strong system foundations.