Founding AI Infra Engineer for Scalable Clusters

Goaly

Palo Alto (CA)

Hybrid

USD 140,000 - 180,000

Full time

14 days+
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Meals and office benefits

Job summary

Goaly seeks exceptional new graduates to join our AI infrastructure team in a hands-on role spanning cloud and datacenter environments. You will own accelerator clusters end-to-end, from capacity onboarding to decommissioning, partnering with hardware, cloud providers, and multiple internal teams to convert heterogeneous compute into a dependable platform.

You will work on control-plane services, observability, security, and reliability, with opportunities to lead multi-quarter initiatives and

Qualifications

  • Strong background in building and operating distributed systems.
  • Experience with cloud platforms and container orchestration.
  • Ability to design for reliability, scalability, and safety in production environments.

Responsibilities

  • Design and operate control-plane services and infrastructure-as-code for provisioning, upgrades, and retirement of accelerator capacity.
  • Coordinate across cloud providers, datacenters, networking, storage, and compute consumers to bring capacity online on schedule.
  • Diagnose performance and reliability issues across hosts, switches, and workload placement; implement remediation.
  • Establish security by default through IAM, network policies, and secure supply chains.
  • Lead incident response and blameless postmortems to reduce recurring pain and improve automation.

Skills

Distributed systems
Cloud platforms
Programming
Linux & containers
Observability & reliability
Cross-team ownership

Education

Bachelor's in CS or related field

Tools

Kubernetes
Terraform
AWS/GCP/Azure
CI/CD
Linux

Job description

Goaly seeks exceptional new graduates to join our AI infrastructure team in a hands-on role spanning cloud and datacenter environments. You will own accelerator clusters end-to-end, from capacity onboarding to decommissioning, partnering with hardware, cloud providers, and multiple internal teams to convert heterogeneous compute into a dependable platform.

You will work on control-plane services, observability, security, and reliability, with opportunities to lead multi-quarter initiatives and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Founding Infra Engineer — AI Accelerator Clusters
Founding Infra Engineer — AI Accelerator Clusters

Goaly AI • Palo Alto (CA)

Hybrid
USD 180,000 - 240,000
Meals and office benefits
Pioneering AI Infrastructure Engineer
Pioneering AI Infrastructure Engineer

Goaly • Palo Alto (CA)

On-site
USD 140,000 - 210,000
Founding Senior Infra Engineer, Distributed Infra
Founding Senior Infra Engineer, Distributed Infra

Goaly AI • Palo Alto (CA)

Hybrid
USD 180,000 - 240,000
Meals and office benefits
Founding Senior Infra Engineer, Distributed Infra
Founding Senior Infra Engineer, Distributed Infra

Goaly • Palo Alto (CA)

Hybrid
USD 140,000 - 180,000
Meals and office benefits
AI Infrastructure Architect — Scalable GPU Compute
AI Infrastructure Architect — Scalable GPU Compute

EngineersOfAI • Sunnyvale (CA)

On-site
USD 150,000 - 200,000
AI Infra & Cluster Engineer — Scale GPU/CPU Orchestration
AI Infra & Cluster Engineer — Scale GPU/CPU Orchestration

Linuxcareers • San Francisco (CA)

On-site
USD 120,000 - 160,000
Senior AI Compute Infra Engineer (Hybrid)
Senior AI Compute Infra Engineer (Hybrid)

Arm Limited • Seattle (WA)

Hybrid
USD 209,000 - 283,000
Relocation package
Recruitment accommodations
Senior AI Infrastructure Engineer
Senior AI Infrastructure Engineer

AI Breaking Wire • Menlo Park (CA), Northern (KY)

Hybrid
USD 200,000 - 350,000
RSUs
Health benefits
Parental leave
+1
Applied AI Engineer — Build End-to-End AI Systems
Applied AI Engineer — Build End-to-End AI Systems

Goaly AI • Palo Alto (CA)

Hybrid
USD 120,000 - 180,000
Complimentary lunch
Dinner provided and snacks
Visa sponsorship available
Founding AI Infra DevRel Engineer
Founding AI Infra DevRel Engineer

Goaly • Palo Alto (CA)

Hybrid
USD 120,000 - 200,000
Visa sponsorship
Meals & perks: lunch, dinner, snacks