Founding Infra Engineer — AI Accelerator Clusters

Goaly AI

Palo Alto (CA)

Hybrid

USD 180,000 - 240,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Meals and office benefits

Job summary

Goaly AI in Palo Alto is building stealth infrastructure to enable AI research at scale. You will own accelerator clusters across their lifecycles—from bringing capacity online to upgrades, failures, recovery, and retirement.

This hands-on role spans cloud and data-center environments, cluster control planes, networking, storage, security, observability, and automation. You will partner with hardware and cloud providers and with Training, RL Systems, Post-Training, Inference, and Security teams

Qualifications

  • Deep expertise in distributed systems, reliability, and cloud platforms.
  • Strong programming ability in Python, Go, Rust.
  • Hands-on experience with Linux, containers, Kubernetes, and IaC.
  • Experience with cloud providers (AWS/GCP/Azure).

Responsibilities

  • Design, build, and operate control-plane services and IaC for provisioning, upgrades, and recovery.
  • Coordinate capacity online with cloud providers, datacenter, and hardware partners.
  • Improve cluster scalability, health signals, and fault tolerance.
  • Lead incident response and blameless postmortems for cluster failures.
  • Collaborate with Training, RL Systems, Post-Training, and Inference teams to plan compute roadmap.

Skills

Distributed systems
Cloud platforms
Python
Go
Rust
Linux
IaC
Kubernetes

Tools

Terraform
Kubernetes

Job description

Goaly AI in Palo Alto is building stealth infrastructure to enable AI research at scale. You will own accelerator clusters across their lifecycles—from bringing capacity online to upgrades, failures, recovery, and retirement.

This hands-on role spans cloud and data-center environments, cluster control planes, networking, storage, security, observability, and automation. You will partner with hardware and cloud providers and with Training, RL Systems, Post-Training, Inference, and Security teams

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Founding AI Infra Engineer for Scalable Clusters
Founding AI Infra Engineer for Scalable Clusters

Goaly • Palo Alto (CA)

Hybrid
USD 140,000 - 180,000
Meals and office benefits
Pioneering AI Infrastructure Engineer
Pioneering AI Infrastructure Engineer

Goaly • Palo Alto (CA)

On-site
USD 140,000 - 210,000
Founding Senior Infra Engineer, Distributed Infra
Founding Senior Infra Engineer, Distributed Infra

Goaly AI • Palo Alto (CA)

Hybrid
USD 180,000 - 240,000
Meals and office benefits
Lead AI Infra Engineer (C/C++) - GPU Training & Equity
Lead AI Infra Engineer (C/C++) - GPU Training & Equity

SpaceXSI • Palo Alto (CA), Seattle (WA)

On-site
USD 220,000 - 357,000
Equity
Medical, vision, and dental
401(k) retirement plan
+3
Founding Senior Infra Engineer, Distributed Infra
Founding Senior Infra Engineer, Distributed Infra

Goaly • Palo Alto (CA)

Hybrid
USD 140,000 - 180,000
Meals and office benefits
AI Infrastructure Architect — Scalable GPU Compute
AI Infrastructure Architect — Scalable GPU Compute

EngineersOfAI • Sunnyvale (CA)

On-site
USD 150,000 - 200,000
GPU Cluster Infra Tech Lead & Team Builder
GPU Cluster Infra Tech Lead & Team Builder

Aisafety • Berkeley (CA)

Hybrid
USD 180,000 - 240,000
Health Insurance
401(k) plan
PTO - 25 days per year
+4
AI Inference Cloud Infra Platform Engineer
AI Inference Cloud Infra Platform Engineer

Gimlet Labs, Inc. • San Francisco (CA)

On-site
USD 150,000 - 390,000
Founding AI Deployment Engineer (FDE)
Founding AI Deployment Engineer (FDE)

Abundant Code • Palo Alto (CA)

On-site
USD 180,000 - 280,000
Visa sponsorship
Complimentary meals
Principal AI/ML Infra Architect - GPU Clusters (Equity)
Principal AI/ML Infra Architect - GPU Clusters (Equity)

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 272,000 - 431,000
Equity
Benefits
Competitive salary