Senior AI Systems Performance Engineer

Goaly; Menlo Park, Northern (CA, KY); Hybrid; USD 150,000 - 180,000; Full time

Job summary

Goaly seeks a systems/performance engineer to optimize AI workloads at scale. You will identify bottlenecks across model code, GPU kernels, memory, and orchestration, building high-throughput, fault-tolerant systems for training and inference.

Collaborate with researchers and other engineers to translate insights into reusable platform capabilities and durable improvements across a production-grade ML stack.

Qualifications

• Significant software-engineering and ML-infrastructure experience at scale.

Responsibilities

• Profile end-to-end AI workloads and identify bottlenecks across model code, GPUs, memory, and networking.

Skills

Distributed systems

Python

Systems programming

Performance engineering

Debugging

Collaboration with researchers

Owner mindset

Communication

Tools

CUDA

Triton

Megatron

Kubernetes

Job description

Goaly seeks a systems/performance engineer to optimize AI workloads at scale. You will identify bottlenecks across model code, GPU kernels, memory, and orchestration, building high-throughput, fault-tolerant systems for training and inference.

Collaborate with researchers and other engineers to translate insights into reusable platform capabilities and durable improvements across a production-grade ML stack.