Head of AI Inference & Systems Platform

Blackhornvc

San Francisco (CA)

On-site

USD 220,000 - 420,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Canyon Code is looking for a Head of Inference to own the end-to-end inference stack, from procuring bare-metal GPU capacity to serving production endpoints. You will work directly with the CEO and Chief Architect, hire and mentor the team, and shape the hardware mix, providers, and serving stack.

This is a hands-on leadership role in a fast-moving, early-stage environment, requiring deep expertise in multi-model inference and Kubernetes on bare metal.

Qualifications

  • End-to-end experience procuring bare-metal GPU capacity and bringing open-weight models to production endpoints.
  • Hands-on expertise with multi-model inference systems and cost-per-token optimization.
  • Deep systems/ops skills: Kubernetes, containers, networking, storage, autoscaling, observability on bare metal.

Responsibilities

  • Own the entire inference path from capacity procurement to serving endpoints.Build and mentor the inference team as the motion scales.Collaborate with the CEO and Chief Architect to select providers, hardware mix, and serving stack.

Job description

Canyon Code is looking for a Head of Inference to own the end-to-end inference stack, from procuring bare-metal GPU capacity to serving production endpoints. You will work directly with the CEO and Chief Architect, hire and mentor the team, and shape the hardware mix, providers, and serving stack.

This is a hands-on leadership role in a fast-moving, early-stage environment, requiring deep expertise in multi-model inference and Kubernetes on bare metal.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Head of Inference
Head of Inference

Blackhornvc • San Francisco (CA)

On-site
USD 220,000 - 420,000
Head of AI Inference Infrastructure
Head of AI Inference Infrastructure

Black.ai • San Francisco (CA)

On-site
USD 180,000 - 260,000
Founding Inference Engineer - AI Serving Lead
Founding Inference Engineer - AI Serving Lead

General Compute • San Francisco (CA)

On-site
USD 190,000 - 230,000
Founding Platform Engineer: AI Inference Cloud
Founding Platform Engineer: AI Inference Cloud

General Compute • San Francisco (CA)

On-site
USD 240,000 - 300,000
Engineering Manager - AI Inference & Systems, Equity
Engineering Manager - AI Inference & Systems, Equity

Inferact • San Francisco (CA)

On-site
USD 200,000 - 400,000
Health benefits
Dental benefits
Vision benefits
+1
Engineering Manager, Scalable Inference Platform
Engineering Manager, Scalable Inference Platform

Anthropic Limited • San Francisco (CA)

Hybrid
USD 405,000 - 625,000
Competitive compensation
Benefits
Equity donation matching
+4
Senior AI Inference Systems Engineer
Senior AI Inference Systems Engineer

StackYak • San Francisco (CA)

Remote
USD 180,000 - 280,000
Senior Inference Engineer, AI Infrastructure & Production
Senior Inference Engineer, AI Infrastructure & Production

Hamilton Barnes • United States

On-site
USD 225,000 - 275,000
Full Benefits
Director, AI Inference & Model Scaling
Director, AI Inference & Model Scaling

Cerebras • Sunnyvale (CA)

Hybrid
USD 250,000 - 450,000
Inference Engineer
Inference Engineer

Hyperbolic • San Francisco (CA)

On-site
USD 150,000 - 190,000