LLM Inference Platform Lead & Product Strategy

Fdetimes; San Francisco (CA); On-site; USD 240,000 - 360,000; Full time

Job summary

Modal is seeking a hands-on technical leader to own the direction and execution of our LLM inference platform. You will lead a group of engineers across the serving stack, routing infrastructure, and optimization layers, shaping the product surface area and performance.

You’ll split time between technical contribution, product shaping, and people management, removing blockers and fostering a culture of ownership and customer obsession as the team tackles frontier workloads and distributed

Qualifications

• 10+ years of industry experience in software/system roles.
• 3+ years in a leadership or management capacity.
• Strong background in cloud infrastructure and large-scale systems.

Responsibilities

• Lead the LLM inference platform end-to-end, including serving stack, routing, and optimization.
• Set direction, unblock blockers, and build a high-performing engineering culture.
• Collaborate with product, customers, and GTM to align roadmap and deployments at scale.

Skills

Leadership

Cloud infrastructure

Distributed systems

OS fundamentals

Job description

Modal is seeking a hands-on technical leader to own the direction and execution of our LLM inference platform. You will lead a group of engineers across the serving stack, routing infrastructure, and optimization layers, shaping the product surface area and performance.

You’ll split time between technical contribution, product shaping, and people management, removing blockers and fostering a culture of ownership and customer obsession as the team tackles frontier workloads and distributed