Group Product Manager, AI Cloud Routing & Token Mgmt

Google LLC; Kirkland (WA); On-site; USD 240,000 - 333,000; Full time

Benefits offered by this job

Health, dental, vision, life, and long

401(k) with company match

Paid time off 20 days/year

Sick time 40 hours/year

Maternity & Baby Bonding leave

13 paid holidays

Job summary

Google LLC in the United States seeks a seasoned Product Manager to lead the Token Management and Intelligent Model Routing platform within Google Cloud. You will bridge networking frontiers with LLM runtime intelligence, guiding end-to-end product strategy from conception to launch.

You will collaborate with engineering, research, and sales to align roadmaps, optimize routing, and deliver enterprise-grade AI governance across hybrid environments.

Qualifications

• Bachelor's degree or equivalent practical experience.
• 10 years of experience in product management or a related technical role.
• 5 years of experience taking technical products from conception to launch (e.g., ideation to execution, end-to-end, 0 to 1).
• Experience with API gateways, cloud networking, distributed proxy architectures, API management (APIM), or enterprise observability/telemetry platforms.
• Experience with Generative AI architectures and LLM APIs, tokenization mechanics, semantic caching, prompt chaining, reasoning loops, and multi-agent frameworks.

Responsibilities

• Establish a bi-modal product strategy serving application developers while meeting FinOps, compliance, and multi-tenant demands of large enterprises.
• Drive market positioning and competitive differentiation against point solutions and hyperscaler native gateways.
• Lead methodology and standards for auto-router benchmarking, agentic evaluation datasets, and real-time routing optimization.
• Analyze multi-objective routing strategies, optimizing across cost, latency, contextual quality, and model availability.
• Define strategy for agentic workloads, planning loops, multi-turn tool calling, and intelligent routing opportunities within agentic graphs.

Skills

Product management

Cross-functional leadership

FinOps

Cost governance

Cloud networking

APIs & gateways

LLM APIs

Generative AI

Education

Bachelor's degree or equivalent

Tools

Envoy

Kubernetes

WebAssembly (Wasm)

Job description

Google LLC in the United States seeks a seasoned Product Manager to lead the Token Management and Intelligent Model Routing platform within Google Cloud. You will bridge networking frontiers with LLM runtime intelligence, guiding end-to-end product strategy from conception to launch.

You will collaborate with engineering, research, and sales to align roadmaps, optimize routing, and deliver enterprise-grade AI governance across hybrid environments.