Head of LLM Inference Platform

Creandum; San Francisco (CA); On-site; USD 350,000 - 520,000; Full time

Job summary

Modal is seeking a hands-on leader to own the direction and execution of its LLM inference platform, delivering frontier performance and developer experience.

You'll split your time between technical contribution, product shaping, and people management, coaching engineers, setting standards, and driving improvements across the serving stack, routing, and optimization platform as we scale with top customers.

Qualifications

• 10+ years of industry experience, including leadership roles.
• Proven record of building high-performance systems at scale.
• Strong background in cloud infrastructure.
• Deep knowledge of OS foundations, containers, and Linux.

Responsibilities

• Lead a team of engineers to deliver scalable LLM inference.
• Drive technical and product direction through reviews and architecture discussions.
• Collaborate with cross-functional teams for roadmap and product launches.
• Establish reliability and end-to-end ownership across projects.

Skills

Leadership experience

Distributed systems

Cloud infrastructure

Low-level OS concepts

LLM inference in production

Job description

Modal is seeking a hands-on leader to own the direction and execution of its LLM inference platform, delivering frontier performance and developer experience.

You'll split your time between technical contribution, product shaping, and people management, coaching engineers, setting standards, and driving improvements across the serving stack, routing, and optimization platform as we scale with top customers.