Head of AI Inference & Systems Platform

Blackhornvc; San Francisco (CA); On-site; USD 220,000 - 420,000; Full time

Job summary

Canyon Code is looking for a Head of Inference to own the end-to-end inference stack, from procuring bare-metal GPU capacity to serving production endpoints. You will work directly with the CEO and Chief Architect, hire and mentor the team, and shape the hardware mix, providers, and serving stack.

This is a hands-on leadership role in a fast-moving, early-stage environment, requiring deep expertise in multi-model inference and Kubernetes on bare metal.

Qualifications

• End-to-end experience procuring bare-metal GPU capacity and bringing open-weight models to production endpoints.
• Hands-on expertise with multi-model inference systems and cost-per-token optimization.
• Deep systems/ops skills: Kubernetes, containers, networking, storage, autoscaling, observability on bare metal.

Responsibilities

• Own the entire inference path from capacity procurement to serving endpoints.Build and mentor the inference team as the motion scales.Collaborate with the CEO and Chief Architect to select providers, hardware mix, and serving stack.

Job description

Canyon Code is looking for a Head of Inference to own the end-to-end inference stack, from procuring bare-metal GPU capacity to serving production endpoints. You will work directly with the CEO and Chief Architect, hire and mentor the team, and shape the hardware mix, providers, and serving stack.

This is a hands-on leadership role in a fast-moving, early-stage environment, requiring deep expertise in multi-model inference and Kubernetes on bare metal.