Platform Engineer

Black.ai

San Francisco (CA)

On-site

USD 180,000 - 260,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Black.ai in San Francisco is hiring to build the inference cloud: the control plane, API, and serving layer that turn racks into a sellable product. You will define how a mixed-hardware inference cloud gets scheduled, routed, and served reliably, in close partnership with data center teams and hardware vendors.

This early role rewards hands-on engineers who thrive on hard problems, own platform architecture, and help scale a ~6–7 person company.

Qualifications

  • Strong systems engineering background in distributed cloud control planes.
  • Proven track record building reliability from scratch.
  • Experience with resource scheduling for heterogeneous compute pools.
  • Comfort working as an early hire in a small team.
  • Familiarity with multi-cluster federation or distributed consensus systems.

Responsibilities

  • Define and own the control plane for mixed-ASIC/GPU scheduling.
  • Build API and serving layer exposing rack capacity as product.
  • Ensure reliability and observability from day one.
  • Scale platform ahead of demand and collaborate with data center teams.
  • Partner with inference engineers on model deployment strategy.

Skills

Distributed systems
Cloud infrastructure
Kubernetes-style schedulers
Reliability engineering
Resource scheduling
Heterogeneous compute
Multi-cluster federation
Software engineering

Tools

Kubernetes
Raft
ZooKeeper

Job description

About us

General Compute is the neocloud for alternative chips.

Inference is fragmenting: purpose-built silicon from SambaNova, Cerebras, Positron, d-Matrix, and others already beats GPUs on decode, and we productionize that hardware — we buy the racks, find the data center space, and run it for our customers. Each piece of hardware runs the workload it's actually built for: prefill stays on GPUs, decode moves to the chip built for it, and today that means generating tokens 5–7× faster than existing GPU-based competitors. Our customers are frontier labs, fast-growing AI application companies, and asset-light clouds.

We closed a $15M seed round in May 2026, and have since closed a $400M debt facility — $100M funded upfront by Upper90, with the balance available for drawdown — collateralized by our inference chips.

About the role

You will build the inference cloud itself — the control plane, API, and serving layer that turn racks into a sellable product. There's no existing platform team to inherit or manage, no legacy system to work around, and no established playbook to follow — just the platform itself to build, with reliability treated as core infrastructure from day one rather than something bolted on after the first outage.The technical problem is also genuinely unsolved elsewhere. The fleet is heterogeneous by design — GPUs for prefill, multiple ASIC vendors for decode — so there's no single-vendor playbook to lean on; you'll be defining how a mixed-hardware inference cloud gets scheduled, routed, and served reliably, in close partnership with the teams standing up the physical fleet.

What you'll do:
  • Build/own the control plane — routing, model placement, scheduling across a mixed ASIC/GPU pool

  • Build the API and serving layer exposing rack capacity as a sellable product

  • Build in reliability and observability from day one

  • Scale the platform ahead of the demand curve

  • Partner closely with data center deployment and model bring-up teams

  • Be a founding technical voice on platform architecture

  • Work at the boundary with the inference team. Own fleet-wide routing, placement, and capacity; hand off to the Inference Engineer for per-model serving performance (batching, KV-cache, quantization) rather than owning that layer yourself

What we need from you:
  • Strong systems engineering background on distributed cloud control planes and multi-tenant orchestration at scale (e.g., Kubernetes-style schedulers)

  • Comfort being a high-impact IC rather than a manager

  • Track record building reliability from scratch

  • Experience with resource scheduling or bin-packing algorithms for heterogeneous compute pools

  • Experience with multi-cluster federation or distributed consensus systems (Raft, ZooKeeper, or similar)

  • Comfort with hardware heterogeneity/ambiguity

  • Genuine interest in being an early hire at a ~6–7 person company

Nice-to-haves:
  • Experience with distributed job schedulers or cluster orchestration systems (Kubernetes, Nomad, Slurm, or similar)

  • Experience running non-NVIDIA accelerators (TPUs/ASICs) in production

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Founding Platform Engineer
Founding Platform Engineer

General Compute • San Francisco (CA)

On-site
USD 240,000 - 300,000
Head of Inference Infrastructure
Head of Inference Infrastructure

General Compute • San Francisco (CA)

On-site
USD 190,000 - 280,000
Head of Infrastructure
Head of Infrastructure

General Compute • San Francisco (CA)

On-site
USD 190,000 - 280,000
Head of Infrastructure
Head of Infrastructure

Black.ai • San Francisco (CA)

On-site
USD 180,000 - 260,000
Inference Engineer
Inference Engineer

Black.ai • San Francisco (CA)

On-site
USD 190,000 - 240,000
Head of Infrastructure (Remote)
Head of Infrastructure (Remote)

General Compute • San Francisco (CA)

Remote
USD 180,000 - 250,000
Founding Network Engineer
Founding Network Engineer

General Compute • San Francisco (CA)

On-site
USD 180,000 - 260,000
Founding Inference Engineer
Founding Inference Engineer

General Compute • San Francisco (CA)

On-site
USD 190,000 - 230,000
Network Engineer
Network Engineer

Black.ai • San Francisco (CA)

On-site
USD 180,000 - 240,000
Founding Platform Engineer: AI Inference Cloud
Founding Platform Engineer: AI Inference Cloud

General Compute • San Francisco (CA)

On-site
USD 240,000 - 300,000