Pioneering AI Infrastructure Engineer

Goaly; Palo Alto (CA); On-site; USD 140,000 - 210,000; Full time

Job summary

Goaly is building a world where every company can become its own AI lab. We are seeking an exceptional systems or performance engineer to optimize large-scale AI workloads, spanning post-training, model training, rollout inference, and GPU cluster platforms.

You will work with researchers and systems engineers to identify bottlenecks, develop scalable infrastructure, and translate investigations into durable improvements across distributed workloads.

Qualifications

• Strong programming skills in Python and at least one systems language (C++, Rust, or Go).
• Experience solving large-scale performance or systems problems.

Responsibilities

• Profile AI workloads and identify bottlenecks across GPUs, memory and networking.
• Build low-latency inference systems and optimize GPU execution.
• Improve distributed training performance across heterogeneous hardware.
• Design quantitative performance models and scheduling mechanisms.
• Develop benchmarks and tooling to monitor system behavior.

Skills

Python

C++

Distributed systems

Performance engineering

Go

Rust

Tools

CUDA

Triton

Kubernetes

Job description

Goaly is building a world where every company can become its own AI lab. We are seeking an exceptional systems or performance engineer to optimize large-scale AI workloads, spanning post-training, model training, rollout inference, and GPU cluster platforms.

You will work with researchers and systems engineers to identify bottlenecks, develop scalable infrastructure, and translate investigations into durable improvements across distributed workloads.