Head of AI Inference Platform & Strategy

FriendliAI; San Francisco (CA); On-site; USD 210,000 - 280,000; Full time

Benefits offered by this job

Flexible working hours

Daily meals provided

Unlimited snacks and beverages

Supportive, collaborative environment

Health check-up support and top-tier设备

Startup equity and competitive pay

Job summary

FriendliAI is seeking a Director of Product to own the strategy and evolution of its AI inference platform. You will define how the platform serves models, scales workloads, and delivers gains in performance, reliability, and cost.

This hands-on leadership role requires deep understanding of AI infrastructure and strong collaboration with engineering and research. You will drive end-to-end product initiatives, mentor PMs/PDs, and establish measurement practices to move quickly while maintaining

Qualifications

• 10+ years of product management experience with technically complex platforms or infrastructure.
• Proven experience leading product strategy for AI/ML infrastructure, cloud platforms, or distributed systems.
• Deep understanding of AI inference and LLM serving architectures.

Responsibilities

• Own the product vision, strategy, and roadmap for the AI inference platform.
• Balance performance, scalability, reliability, usability, and cost across the stack.
• Translate complex capabilities into clear customer value and experiences.
• Lead and mentor PMs and product designers to high standards.

Skills

Product leadership

AI infrastructure

Distributed systems

Strategic thinking

Cross-functional

Technical fluency

Customer focus

Communication

Mentoring

Roadmapping

Job description

FriendliAI is seeking a Director of Product to own the strategy and evolution of its AI inference platform. You will define how the platform serves models, scales workloads, and delivers gains in performance, reliability, and cost.

This hands-on leadership role requires deep understanding of AI infrastructure and strong collaboration with engineering and research. You will drive end-to-end product initiatives, mentor PMs/PDs, and establish measurement practices to move quickly while maintaining