Senior GPU & Inference Systems Engineer

Poolside; United States; Remote; USD 140,000 - 200,000; Full time

Job summary

Poolside is seeking an engineer to optimize GPU utilization and deliver a stable, scalable inference serving stack for researchers. You will partner with the inference and scalability teams to improve throughput, latency, and fault tolerance across large-scale training environments.

You’ll collaborate closely with the infra team to ensure GPU nodes are healthy and fully utilized, enabling faster experimentation and pushing Poolside toward its AGI-focused mission.

Qualifications

• Strong programming skills in Go, or other similar languages.
• Strong systems engineering background: distributed systems, schedulers, control planes, or high-throughput data planes.
• Production experience with Kubernetes internals - controllers, informers, operators - not just deploying to it.
• Bias toward observability and debuggability: building a system that is easy to navigate when debugging production issues
• Plus: experience in systems serving large scale inference requests

Responsibilities

• Design and develop internal scheduling system to maximize GPU utilization
• Build API and tooling to help manage the lifecycle of GPU workloads and troubleshoot failures
• Design and improve inference control plane to speed up model deployment and inference request serving
• Collaborate with research to improve research velocity continuously

Skills

Go

Distributed systems

Kubernetes

Observability

Large-scale inference

Tools

Kubernetes controllers

Go tooling

Job description

Poolside is seeking an engineer to optimize GPU utilization and deliver a stable, scalable inference serving stack for researchers. You will partner with the inference and scalability teams to improve throughput, latency, and fault tolerance across large-scale training environments.

You’ll collaborate closely with the infra team to ensure GPU nodes are healthy and fully utilized, enabling faster experimentation and pushing Poolside toward its AGI-focused mission.