Software Engineer

Acceler8 Talent; San Francisco, Northern (CA, KY); On-site; USD 150,000 - 350,000; Full time

Job summary

Acceler8 Talent seeks a Member of Technical Staff – Distributed Systems in San Francisco, CA, onsite. The role focuses on building the orchestration layer for heterogeneous AI compute, enabling scheduling and routing of inference workloads across GPUs, CPUs and accelerators.

Join a fast-growing AI infra team shaping the platform that powers modern workloads. Ideal candidates have production-grade distributed systems experience, strong Go/C++/Python skills, and familiarity with Kubernetes, RPC

Qualifications

• Strong experience building distributed systems in production.
• Experience with scheduling, orchestration, fault tolerance and concurrency.
• Knowledge of Kubernetes, RPC frameworks, asynchronous messaging or control-plane infrastructure.
• Strong programming experience in Go, C++ or Python.
• Experience with AI infrastructure or heterogeneous compute is a plus.

Responsibilities

• Build scheduling, orchestration and control-plane systems for AI compute workloads at scale.

Skills

Distributed Systems

Scheduling

Orchestration

Fault Tolerance

Concurrency

Kubernetes

RPC Frameworks

Async Messaging

Control-Plane

Go

C++

Python

AI Infrastructure

Job description

Member of Technical Staff–Distributed Systems– San Francisco, CA (Onsite)

I'm currently hiring for a rapidly growing AI infrastructure company building the orchestration layer for heterogeneous AI compute. They're developing a production platform that partitions, schedules and routes inference workloads across GPUs, CPUs and emerging accelerators, allowing customers to use the best available hardware without redesigning their infrastructure for every new architecture.

The company recently raised an $80M Series A, has generated eight figures in revenue since emerging from stealth and works with frontier AI labs, hyperscalers and AI-native companies. They're now looking for experienced Distributed Systems Engineers who enjoy solving difficult infrastructure problems at scale. This is an opportunity to build scheduling, orchestration and control-plane systems from first principles while working closely with a highly technical team across compilers, runtimes, kernels and hardware.

What they're looking for:

• Strong experience building distributed systems in production
• Experience with scheduling, orchestration, fault tolerance and concurrency
• Knowledge of Kubernetes, RPC frameworks, asynchronous messaging or control-plane infrastructure
• Strong programming experience in Go, C++ or Python
• Experience with AI infrastructure or heterogeneous compute is a plus

Important details:

• Fully onsite in San Francisco, CA
• $150K–$350K base + equity
• Approximately 30 people