Head of ML Systems & Inference

Doist; San Francisco (CA); On-site; USD 260,000 - 380,000; Full time

Benefits offered by this job

Health, dental, vision benefits

401(k) company match

Job summary

Inferact in San Francisco is seeking a Head of Engineering to build and lead the team developing systems that power vLLM and AI inference. You’ll ensure technical credibility at the inference layer, optimizing runtimes, memory and performance across GPUs and accelerators.

You’ll partner with founders to scale a senior-heavy organization, recruit rare ML systems talent, translate ambitious work into execution plans, and deliver high-performance inference across models, hardware, and deployment

Qualifications

• Bachelor's degree or equivalent experience in CS/engineering or related field.
• Engineering leadership experience building and scaling specialized teams in LLM inference or ML systems.
• Deep technical credibility at the inference layer, including runtimes and hardware-software tradeoffs.

Responsibilities

• Lead the engineering organization developing systems powering vLLM and Inferact.
• Translate research into focused execution plans and measureable milestones.
• Recruit, coach, and retain senior engineers and staff-level ICs for production readiness.

Skills

LLM Inference

Engineering Leadership

GPU optimization

Distributed Systems

People leadership

Education

Bachelor's degree

Tools

SGLang

PyTorch

Triton

XLA

ROCm

Job description

Inferact in San Francisco is seeking a Head of Engineering to build and lead the team developing systems that power vLLM and AI inference. You’ll ensure technical credibility at the inference layer, optimizing runtimes, memory and performance across GPUs and accelerators.

You’ll partner with founders to scale a senior-heavy organization, recruit rare ML systems talent, translate ambitious work into execution plans, and deliver high-performance inference across models, hardware, and deployment