Director of AI Inference Platform & Strategy

FriendliAI Inc.; San Francisco (CA); On-site; USD 180,000 - 280,000; Full time

Benefits offered by this job

Flexible working hours

Lunch and dinner provided

Collaborative work environment

Health check-up support

Top-tier equipment

Equity and health insurance

Job summary

FriendliAI Inc. seeks a Director of Product to own the strategy and evolution of our AI inference platform. You will lead a technically strong team, translate complex systems into tangible products, and drive performance, reliability, and cost improvements across production workloads.

You will mentor PMs and designers while shaping the product organization as FriendliAI scales, partnering with engineering, research, and GTM to win in a fast‑moving AI market.

Qualifications

• 10+ years of product management experience on technically complex platforms.
• Proven experience leading AI/ML infrastructure products.
• Deep understanding of AI inference and LLM serving architectures.

Responsibilities

• Own product vision, strategy, and roadmap for AI inference platform.
• Collaborate with engineering/research to shape capabilities across routing, batching, scheduling, and optimization.
• Drive metrics like latency, throughput, GPU utilization, and cost per inference.
• Engage with enterprise customers to validate direction and opportunities.
• Partner with Sales/CS/Marketing to translate needs into priorities.

Skills

AI infrastructure

Product strategy

Leadership

Cross-functional collaboration

Technical fluency

Stakeholder management

Education

Background in CS or Engineering

Tools

vLLM

TensorRT-LLM

SGLang

GPU infrastructure

Model deployment

Job description

FriendliAI Inc. seeks a Director of Product to own the strategy and evolution of our AI inference platform. You will lead a technically strong team, translate complex systems into tangible products, and drive performance, reliability, and cost improvements across production workloads.

You will mentor PMs and designers while shaping the product organization as FriendliAI scales, partnering with engineering, research, and GTM to win in a fast‑moving AI market.