Founding Infra Engineer — AI Accelerator Clusters

Goaly AI

Palo Alto (CA)

Hybrid

USD 180,000 - 240,000

Full time

41 hours ago
Be an early applicant
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Benefits offered by this job

Meals and office benefits

Job summary

Goaly AI in Palo Alto is building stealth infrastructure to enable AI research at scale. You will own accelerator clusters across their lifecycles—from bringing capacity online to upgrades, failures, recovery, and retirement.

This hands-on role spans cloud and data-center environments, cluster control planes, networking, storage, security, observability, and automation. You will partner with hardware and cloud providers and with Training, RL Systems, Post-Training, Inference, and Security teams

Qualifications

  • Deep expertise in distributed systems, reliability, and cloud platforms.
  • Strong programming ability in Python, Go, Rust.
  • Hands-on experience with Linux, containers, Kubernetes, and IaC.
  • Experience with cloud providers (AWS/GCP/Azure).

Responsibilities

  • Design, build, and operate control-plane services and IaC for provisioning, upgrades, and recovery.
  • Coordinate capacity online with cloud providers, datacenter, and hardware partners.
  • Improve cluster scalability, health signals, and fault tolerance.
  • Lead incident response and blameless postmortems for cluster failures.
  • Collaborate with Training, RL Systems, Post-Training, and Inference teams to plan compute roadmap.

Skills

Distributed systems
Cloud platforms
Python
Go
Rust
Linux
IaC
Kubernetes

Tools

Terraform
Kubernetes

Job description

Goaly AI in Palo Alto is building stealth infrastructure to enable AI research at scale. You will own accelerator clusters across their lifecycles—from bringing capacity online to upgrades, failures, recovery, and retirement.

This hands-on role spans cloud and data-center environments, cluster control planes, networking, storage, security, observability, and automation. You will partner with hardware and cloud providers and with Training, RL Systems, Post-Training, Inference, and Security teams

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Engineer, Cluster Infrastructure & AI Compute
Staff Engineer, Cluster Infrastructure & AI Compute

Goaly • Menlo Park (CA), Northern (KY)

Hybrid
USD 180,000 - 240,000
Meals and office benefits
Visa sponsorship
Pioneering AI Infrastructure Engineer
Pioneering AI Infrastructure Engineer

Goaly • Palo Alto (CA)

On-site
USD 140,000 - 210,000
Founding Senior Infra Engineer, Distributed Infra
Founding Senior Infra Engineer, Distributed Infra

Goaly AI • Palo Alto (CA)

Hybrid
USD 180,000 - 240,000
Meals and office benefits
Senior AI Compute Infra Engineer (Hybrid)
Senior AI Compute Infra Engineer (Hybrid)

Arm Limited • Seattle (WA)

Hybrid
USD 209,000 - 283,000
Relocation package
Recruitment accommodations
Senior AI Infrastructure Lead: GPU Clusters & LLMs
Senior AI Infrastructure Lead: GPU Clusters & LLMs

Cadence Design Systems • San Jose (CA)

On-site
USD 137,000 - 254,000
Senior AI Infrastructure Engineer
Senior AI Infrastructure Engineer

AI Breaking Wire • Menlo Park (CA), Northern (KY)

Hybrid
USD 200,000 - 350,000
RSUs
Health benefits
Parental leave
+1
Applied AI Engineer — Build End-to-End AI Systems
Applied AI Engineer — Build End-to-End AI Systems

Goaly AI • Palo Alto (CA)

Hybrid
USD 120,000 - 180,000
Complimentary lunch
Dinner provided and snacks
Visa sponsorship available
AI Infrastructure Architect — Scalable GPU Compute
AI Infrastructure Architect — Scalable GPU Compute

EngineersOfAI • Sunnyvale (CA)

On-site
USD 150,000 - 200,000
Infrastructure Engineer
Infrastructure Engineer

Acceler8 Talent • San Francisco (CA), Northern (KY)

Hybrid
USD 150,000 - 390,000
Equity
GPU Cluster Infra Tech Lead & Team Builder
GPU Cluster Infra Tech Lead & Team Builder

AISafety • Berkeley (CA)

Hybrid
USD 180,000 - 240,000
Health Insurance
401(k) plan
PTO - 25 days per year
+4