Founding Engineer — ML Platforms Engineer

cumulus labs

San Francisco (CA)

On-site

USD 180,000 - 280,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Cumulus Labs is seeking an ML Platforms Engineer to build and run the orchestration layer under our AI inference and agent products. You'll schedule workloads, allocate GPUs, and keep a heterogeneous, multi-cloud fleet running at high utilization.

The stack emphasizes Go, Kubernetes, and Terraform, but we value problem-solving over language familiarity. Work closely with the founder, design scalable, production-ready systems, and own the platform end to end in a small team.

Qualifications

  • Strong fundamentals in data structures and algorithms.
  • Experience with distributed systems and production-scale services.
  • Ability to reason about tradeoffs and system design.

Responsibilities

  • Build and extend GPU orchestrator: scheduling, fractional allocation, live migration with no downtime.
  • Design multi-tenant primitives: quotas, isolation, usage metering, tenant-facing gateway.
  • Own observability: metrics, logs, traces at scale.
  • Debug hard, systems-level problems from scheduling to GPU memory and networking.
  • Make architectural decisions and ship fast, owning end-to-end systems with the founder.

Skills

Go
Kubernetes
Terraform
Distributed systems
Algorithms
Data structures
Production-grade systems
Multi-cloud

Job description

About the role

Cumulus Labs builds the software that turns raw GPU capacity into fast, cheap, production AI. We're looking for an ML Platforms Engineer to help build and run the orchestration layer underneath our inference and agent products, the system that schedules workloads, allocates GPUs, and keeps a heterogeneous, multi-cloud fleet running at high utilization.

We care more about how you think than which languages are on your resume. Our stack today includes Go, Kubernetes, and Terraform, but we're looking for someone who can walk into any part of a production system, understand it, and make it better, not someone who only knows one toolchain.

What you'll do
  • Build and extend our GPU orchestrator: scheduling, fractional allocation, live workload migration across GPUs with no downtime

  • Design and evolve multi-tenant primitives: quotas, isolation, usage metering, a tenant-facing inference gateway

  • Own observability for the fleet: metrics, logs, and traces at scale

  • Debug hard, systems-level problems across the stack, from scheduling logic down to GPU memory and networking

  • Make real architectural decisions, not just implement someone else's design

  • Ship fast, own your systems end to end, and work directly with the founder

What we're looking for
  • Excellent fundamentals: data structures, algorithms, distributed systems concepts, and the judgment to apply the right pattern to the right problem

  • Real production experience, ideally with systems that had to stay up and scale under load

  • Strong design instincts: you can reason about tradeoffs, not just follow a framework's conventions

  • Fast learner who can go deep in unfamiliar territory; specific experience with Go or Kubernetes is a plus, not a requirement

  • Comfortable using modern AI coding tools (we use Claude Code heavily) to move fast without losing rigor

  • You want to work in person, in a small team, solving problems nobody has solved before

Why Cumulus

We're small, early, and building the systems layer for the next generation of AI infrastructure. You'll own real infrastructure from day one, not tickets in a backlog.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Founding ML Platforms Engineer: GPU Orchestrator Lead
Founding ML Platforms Engineer: GPU Orchestrator Lead

cumulus labs • San Francisco (CA)

On-site
USD 180,000 - 280,000
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)

Perplexity • United States

On-site
USD 180,000 - 240,000
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)

Perplexity • United States

Remote
USD 180,000 - 320,000
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)

Perplexity AI • San Francisco (CA)

On-site
USD 180,000 - 280,000
Software Engineer, AI Infrastructure
Software Engineer, AI Infrastructure

Harell Data • Palo Alto (CA)

On-site
USD 180,000 - 260,000
Platform Engineer
Platform Engineer

Harrison Clarke • San Francisco (CA)

On-site
USD 120,000 - 160,000
Fullstack Engineer – Data Platform
Fullstack Engineer – Data Platform

General Intuition • New York (NY)

On-site
USD 150,000 - 210,000
Member of Technical Staff - Infrastructure
Member of Technical Staff - Infrastructure

Gimlet Labs • San Francisco (CA)

On-site
USD 120,000 - 160,000
Platform Engineer
Platform Engineer

Black.ai • San Francisco (CA)

On-site
USD 180,000 - 260,000
Member of Technical Staff - Platform
Member of Technical Staff - Platform

Hyperbolic • San Francisco (CA)

On-site
USD 140,000 - 210,000