Inference Platform TPM — Roadmaps, Releases & Scale

Fdetimes; San Francisco (CA); In loco; USD 150.000 - 210.000; Tempo pieno

Descrizione del lavoro

Perplexity is looking for a technical program manager to be the connective tissue between our model providers, engineering, and product teams, driving our core inference platform forward. The ideal candidate has strong technical judgment and thrives coordinating across teams and external partners with competing timelines.

You will orchestrate onboarding, launch readiness, and rollout for new models and capacity, while tracking latency, throughput, uptime, and cost to keep the system fast,

Competenze

• 6+ years of combined technical program management or product management experience.
• Experience with data and metrics to surface difficult tradeoffs between latency, throughput, uptime, and cost.
• Comfort coordinating with external partners and internal teams with competing priorities and timelines.

Mansioni

• Execute the roadmap for the inference platform request handling, rate limits and quotas, usage controls, and the reliability and observability surface engineering and product teams depend on
• Be the connective tissue between model providers and Perplexity's engineering and product teams coordinating onboarding, launch readiness, and rollout for new models and capacity
• Drive latency, throughput, uptime, and cost-efficiency as core execution metrics, surfacing tradeoffs between them rather than letting them become side effects
• Run the operating model for model-release and optimization programs, including day-zero launches, across performance engineering, infrastructure, and product teams
• Lead cross-functional delivery for inference-stack changes, from planning through launch and post-launch validation
• Build the mechanisms that make releases predictable rituals, dashboards, launch checklists so inference releases stay low-risk at Perplexity's scale
• Partner with GPU capacity and compute teams to reconcile execution decisions against cost, capacity, and vendor constraints

Conoscenze

Technical program management

Product management

Infrastructure

Distributed systems

ML/model-serving

Descrizione del lavoro

Perplexity is looking for a technical program manager to be the connective tissue between our model providers, engineering, and product teams, driving our core inference platform forward. The ideal candidate has strong technical judgment and thrives coordinating across teams and external partners with competing timelines.

You will orchestrate onboarding, launch readiness, and rollout for new models and capacity, while tracking latency, throughput, uptime, and cost to keep the system fast,