Founding Platform Engineer: AI Inference Cloud

General Compute

San Francisco (CA)

On-site

USD 240,000 - 300,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

General Compute is hiring to build the inference cloud — the control plane, API, and serving layer that turns racks into a sellable product. You’ll define how a mixed ASIC/GPU fleet is scheduled, routed, and served with reliability as core infrastructure from day one.

You will be a founding technical voice, an IC contributor focused on scalable cloud infrastructure, with a track record building reliability from scratch and comfort with hardware heterogeneity.

Qualifications

  • Strong systems engineering background on cloud control planes and serving infra at scale.
  • Preference for individual contributor over management.
  • Proven track record building reliability from scratch.
  • Comfort with hardware heterogeneity and ambiguity.
  • Interest in joining an early-stage team of ~6–7 people.

Responsibilities

  • Build/own the control plane for mixed ASIC/GPU fleet scheduling.
  • Build the API and serving layer exposing rack capacity as a product.
  • Institute reliability and observability from day one.
  • Scale the platform ahead of demand.
  • Collaborate with data center deployment and model bring-up teams.

Skills

Systems engineering
Cloud control planes
Serving infrastructure
Reliability engineering
Hardware heterogeneity

Education

BS/MS in CS or EE

Tools

Kubernetes
Prometheus
Observability tooling

Job description

General Compute is hiring to build the inference cloud — the control plane, API, and serving layer that turns racks into a sellable product. You’ll define how a mixed ASIC/GPU fleet is scheduled, routed, and served with reliability as core infrastructure from day one.

You will be a founding technical voice, an IC contributor focused on scalable cloud infrastructure, with a track record building reliability from scratch and comfort with hardware heterogeneity.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Head of AI Inference Infrastructure
Head of AI Inference Infrastructure

Black.ai • San Francisco (CA)

On-site
USD 180,000 - 260,000
Founding Inference Engineer - AI Serving Lead
Founding Inference Engineer - AI Serving Lead

General Compute • San Francisco (CA)

On-site
USD 190,000 - 230,000
Founding Platform Engineer
Founding Platform Engineer

General Compute • San Francisco (CA)

On-site
USD 240,000 - 300,000
Platform Engineer
Platform Engineer

Black.ai • San Francisco (CA)

On-site
USD 180,000 - 260,000
Head of Inference Cloud Infrastructure
Head of Inference Cloud Infrastructure

General Compute • San Francisco (CA)

Remote
USD 180,000 - 250,000
Platform Engineer, Heterogeneous Inference Cloud
Platform Engineer, Heterogeneous Inference Cloud

Black.ai • San Francisco (CA)

On-site
USD 180,000 - 260,000
Founding Network Engineer for AI Inference Data Center
Founding Network Engineer for AI Inference Data Center

General Compute • San Francisco (CA)

On-site
USD 180,000 - 260,000
Founding Inference Serving Engineer
Founding Inference Serving Engineer

Black.ai • San Francisco (CA)

On-site
USD 190,000 - 240,000
GPU Cloud Platform Lead for AI Inference
GPU Cloud Platform Lead for AI Inference

Blue Signal LLC. • United States

On-site
USD 250,000 - 350,000
Remote GPU Inference Infra Platform Engineer
Remote GPU Inference Infra Platform Engineer

Together Computer Inc • United States

Remote
USD 180,000 - 240,000