Founding Infra Engineer — AI Accelerator Clusters

Goaly AI; Palo Alto (CA); Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Meals and office benefits

Job summary

Goaly AI in Palo Alto is building stealth infrastructure to enable AI research at scale. You will own accelerator clusters across their lifecycles—from bringing capacity online to upgrades, failures, recovery, and retirement.

This hands-on role spans cloud and data-center environments, cluster control planes, networking, storage, security, observability, and automation. You will partner with hardware and cloud providers and with Training, RL Systems, Post-Training, Inference, and Security teams

Qualifications

• Deep expertise in distributed systems, reliability, and cloud platforms.
• Strong programming ability in Python, Go, Rust.
• Hands-on experience with Linux, containers, Kubernetes, and IaC.
• Experience with cloud providers (AWS/GCP/Azure).

Responsibilities

• Design, build, and operate control-plane services and IaC for provisioning, upgrades, and recovery.
• Coordinate capacity online with cloud providers, datacenter, and hardware partners.
• Improve cluster scalability, health signals, and fault tolerance.
• Lead incident response and blameless postmortems for cluster failures.
• Collaborate with Training, RL Systems, Post-Training, and Inference teams to plan compute roadmap.

Skills

Distributed systems

Cloud platforms

Python

Go

Rust

Linux

IaC

Kubernetes

Tools

Terraform

Kubernetes

Job description

Goaly AI in Palo Alto is building stealth infrastructure to enable AI research at scale. You will own accelerator clusters across their lifecycles—from bringing capacity online to upgrades, failures, recovery, and retirement.

This hands-on role spans cloud and data-center environments, cluster control planes, networking, storage, security, observability, and automation. You will partner with hardware and cloud providers and with Training, RL Systems, Post-Training, Inference, and Security teams