Group Product Manager — Inference & Token Infrastructure

Volta

Palo Alto, Northern (CA, KY)

Hybrid

USD 180,000 - 230,000

Full time

14 days+
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Benefits offered by this job

Competitive salary
Equity in Volta
Retirement/pension contributions
Comprehensive health benefits
Generous vacation days

Job summary

Volta seeks a Group Product Manager for inference infrastructure and the token factory in Palo Alto. You will lead a team of product managers focused on making AI workloads faster, cheaper, and more reliable, turning compute into tokens at scale.

You will partner with platform engineering to define features, track performance metrics, and align roadmaps with customer needs in a fast-moving AI space.

Qualifications

  • Significant product management experience in AI/ML infrastructure or inference serving is essential.
  • Experience managing other product managers or leading a product team.
  • Strong technical understanding of model serving, inference optimization, or GPU compute.
  • A track record shipping infrastructure products in a fast-evolving technical space.

Responsibilities

  • Own product strategy and roadmap for inference infrastructure and token-serving capabilities.
  • Lead and develop a team of product managers focused on inference and serving infrastructure.
  • Partner with platform engineering to define features that improve inference throughput, latency, and cost efficiency.
  • Track industry and customer trends in inference workloads and translate them into roadmap priorities.
  • Define and monitor metrics for inference performance and efficiency.
  • Represent inference and token-serving priorities in cross-functional and leadership planning.
  • Work with key customers to understand evolving inference needs.

Skills

Product management
Team leadership
Technical understanding

Job description

Volta seeks a Group Product Manager for inference infrastructure and the token factory in Palo Alto. You will lead a team of product managers focused on making AI workloads faster, cheaper, and more reliable, turning compute into tokens at scale.

You will partner with platform engineering to define features, track performance metrics, and align roadmaps with customer needs in a fast-moving AI space.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Group Product Manager - Inference and Token Factory
Group Product Manager - Inference and Token Factory

Volta • Palo Alto (CA), Northern (KY)

On-site
USD 180,000 - 230,000
Competitive salary
Equity in Volta
Retirement/pension contributions
+2
Group Program Lead, AI Infrastructure & GPU Deployments
Group Program Lead, AI Infrastructure & GPU Deployments

Volta • Palo Alto (CA), Northern (KY)

Hybrid
USD 180,000 - 260,000
Equity in Volta
Competitive salary
Retirement/pension contributions
+2
Senior Product Marketing Strategist for AI Infrastructure
Senior Product Marketing Strategist for AI Infrastructure

Volta • Palo Alto (CA)

On-site
USD 150,000 - 210,000
Equity in Volta
Retirement/pension contributions
Comprehensive health benefits
+1
Group Product Manager, Security & Confidential Computing
Group Product Manager, Security & Confidential Computing

Volta • Palo Alto (CA), Northern (KY)

Hybrid
USD 210,000 - 320,000
Competitive salary
Equity
Retirement contributions
+2
Platform PM, AI Inference & Infrastructure
Platform PM, AI Inference & Infrastructure

Fireworks AI • San Mateo (CA)

On-site
USD 120,000 - 180,000
Group Product Manager, Managed Inference & AI Cloud
Group Product Manager, Managed Inference & AI Cloud

Crusoe Energy Systems LLC • San Francisco (CA)

On-site
USD 233,000 - 282,000
Industry competitive pay
Restricted Stock Units
Health insurance options
+6
Product Manager, AI Infrastructure & Open Systems
Product Manager, AI Infrastructure & Open Systems

RadixArk • Palo Alto (CA)

On-site
USD 100,000 - 140,000
Competitive salary and equity package
Work with a world-class team
Direct impact on future of AI infrastructure
Senior Product Manager – AI Infrastructure & Scale
Senior Product Manager – AI Infrastructure & Scale

Baseten • United States

Remote
USD 150,000 - 190,000
Head of Platform Engineering — Scalable AI Infra
Head of Platform Engineering — Scalable AI Infra

Volta • Palo Alto (CA)

On-site
USD 260,000 - 380,000
Equity
Retirement plan
Health benefits
+1
Senior PM, AI Inference Platform - Equity & Impact
Senior PM, AI Inference Platform - Equity & Impact

NVIDIA Gruppe • Santa Clara (CA)

On-site
USD 168,000 - 328,000
Equity
Benefits