Pioneering AI Infrastructure Engineer

Goaly

Palo Alto (CA)

On-site

USD 140,000 - 210,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Goaly is building a world where every company can become its own AI lab. We are seeking an exceptional systems or performance engineer to optimize large-scale AI workloads, spanning post-training, model training, rollout inference, and GPU cluster platforms.

You will work with researchers and systems engineers to identify bottlenecks, develop scalable infrastructure, and translate investigations into durable improvements across distributed workloads.

Qualifications

  • Strong programming skills in Python and at least one systems language (C++, Rust, or Go).
  • Experience solving large-scale performance or systems problems.

Responsibilities

  • Profile AI workloads and identify bottlenecks across GPUs, memory and networking.
  • Build low-latency inference systems and optimize GPU execution.
  • Improve distributed training performance across heterogeneous hardware.
  • Design quantitative performance models and scheduling mechanisms.
  • Develop benchmarks and tooling to monitor system behavior.

Skills

Python
C++
Distributed systems
Performance engineering
Go
Rust

Tools

CUDA
Triton
Kubernetes

Job description

Goaly is building a world where every company can become its own AI lab. We are seeking an exceptional systems or performance engineer to optimize large-scale AI workloads, spanning post-training, model training, rollout inference, and GPU cluster platforms.

You will work with researchers and systems engineers to identify bottlenecks, develop scalable infrastructure, and translate investigations into durable improvements across distributed workloads.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Founding Infra Engineer — AI Accelerator Clusters
Founding Infra Engineer — AI Accelerator Clusters

Goaly AI • Palo Alto (CA)

Hybrid
USD 180,000 - 240,000
Meals and office benefits
Founding AI Infra Engineer for Scalable Clusters
Founding AI Infra Engineer for Scalable Clusters

Goaly • Palo Alto (CA)

Hybrid
USD 140,000 - 180,000
Meals and office benefits
AI Infrastructure Architect — Scalable GPU Compute
AI Infrastructure Architect — Scalable GPU Compute

EngineersOfAI • Sunnyvale (CA)

On-site
USD 150,000 - 200,000
Lead AI Infra Engineer (C/C++) - GPU Training & Equity
Lead AI Infra Engineer (C/C++) - GPU Training & Equity

SpaceXSI • Palo Alto (CA), Seattle (WA)

On-site
USD 220,000 - 357,000
Equity
Medical, vision, and dental
401(k) retirement plan
+3
Founding Senior Infra Engineer, Distributed Infra
Founding Senior Infra Engineer, Distributed Infra

Goaly AI • Palo Alto (CA)

Hybrid
USD 180,000 - 240,000
Meals and office benefits
Global AI Compute Infrastructure Engineer
Global AI Compute Infrastructure Engineer

OpenAI, Inc. • United States

On-site
USD 150,000 - 300,000
New Grad MST: AI Systems Engineer
New Grad MST: AI Systems Engineer

Goaly • Menlo Park (CA)

Hybrid
USD 120,000 - 170,000
Meals and office benefits
Autonomous GPU Infrastructure Engineer
Autonomous GPU Infrastructure Engineer

Sptix AI LLP • San Francisco (CA)

On-site
USD 190,000 - 270,000
Health insurance
Startup equity
Competitive benefits
Founding Infrastructure Engineer - GPU & AI Ops
Founding Infrastructure Engineer - GPU & AI Ops

Peanoai • Palo Alto (CA)

On-site
USD 180,000 - 260,000
Principal AI Infrastructure Engineer
Principal AI Infrastructure Engineer

gatikaiinc • Mountain View (CA)

On-site
USD 180,000 - 260,000