Staff Distributed Systems Engineer - AI Infrastructure

Acceler8 Talent; San Francisco, Northern (CA, KY); Hybrid; USD 180,000 - 260,000; Full time

Job summary

Acceler8 Talent in San Francisco is seeking a Member of Technical Staff to lead distributed systems at the core of our AI infrastructure. You’ll design, build, and operate scheduling, routing, and coordination for AI workloads across CPUs, GPUs, and accelerators.

You’ll work closely with inference, runtimes, compilers, kernels, and hardware teams to push the limits of scale and reliability. This on-site role offers meaningful ownership from day one in a fast-growing startup.

Qualifications

• Strong distributed systems experience in production.
• Deep understanding of concurrency, failure modes, scalability, and system trade-offs.
• Experience with Go, C++, or Python.
• Exposure to scheduling, queues, RPC, control planes, or Kubernetes internals.
• Strong evidence of personally building, debugging, or optimising complex systems.

Responsibilities

• Build distributed scheduling, orchestration, and control-plane systems.
• Improve reliability, fault tolerance, and workload placement across large-scale infrastructure.
• Develop RPC, asynchronous messaging, and resource-management systems.
• Build production APIs that abstract hardware complexity from customers.
• Work on Kubernetes-adjacent infrastructure beyond simply operating clusters.
• Collaborate across inference, runtimes, compilers, kernels, and hardware.

Skills

Distributed systems

Go

C++

Python

RPC

Kubernetes

Job description

Acceler8 Talent in San Francisco is seeking a Member of Technical Staff to lead distributed systems at the core of our AI infrastructure. You’ll design, build, and operate scheduling, routing, and coordination for AI workloads across CPUs, GPUs, and accelerators.

You’ll work closely with inference, runtimes, compilers, kernels, and hardware teams to push the limits of scale and reliability. This on-site role offers meaningful ownership from day one in a fast-growing startup.