Staff Engineer, Cluster Infrastructure & AI Compute

Goaly; Menlo Park, Northern (CA, KY); Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Meals and office benefits

Visa sponsorship

Job summary

Goaly is seeking an experienced infrastructure engineer to own the lifecycle of accelerator clusters across cloud and datacenter environments. You will design and operate control-plane services, provisioning, upgrades, and decommissioning while partnering with multiple teams to turn heterogeneous compute into a dependable platform.

You will work on a hands-on, hybrid role spanning networking, storage, security, and automation.

Qualifications

• Experience in distributed systems, cloud platforms, and reliable infra services.
• Experience with Kubernetes, IaC, and at least one major cloud provider.
• Strong programming ability in Python, Go, or Rust for automation and tooling.
• Hands-on Linux, containers, and cluster schedulers; practical networking and observability.

Responsibilities

• Design, build, and operate control-plane services and infrastructure-as-code for provisioning, upgrades, and recovery.
• Bring accelerator capacity online across cloud and datacenter environments.
• Improve fault tolerance and scalability with automated remediation and health signals.
• Ensure security by default with identity controls, network policy, and trusted software supply chains.
• Establish observability for cluster readiness, capacity, and recovery times.
• Lead incident response and blameless postmortems for cluster failures.
• Collaborate with Training, RL Systems, Post-Training, and Inference teams to shape compute and capacity roadmap.

Skills

Distributed systems

Kubernetes

Cloud platforms

Python/Go/Rust

Linux

IaC

Observability

Networking

Tools

Terraform

Kubernetes

Slurm

Job description

Goaly is seeking an experienced infrastructure engineer to own the lifecycle of accelerator clusters across cloud and datacenter environments. You will design and operate control-plane services, provisioning, upgrades, and decommissioning while partnering with multiple teams to turn heterogeneous compute into a dependable platform.

You will work on a hands-on, hybrid role spanning networking, storage, security, and automation.