Product Manager - AI Inference

AIToolboard; Alexandria (VA); Hybrid; USD 140,000 - 190,000; Full time

Job summary

VirtualVocations is seeking a Product Manager for AI Inference to own the strategy and lifecycle of AI inference and model serving. You will collaborate with engineering teams to optimize GPU, network, and storage performance in a remote environment.

You will drive technical discovery, translate findings into prioritized requirements, and lead go-to-market efforts with customers and partners. The role demands experience in production AI inference and strong communication with platform

Qualifications

• 7+ years in product management or a senior technical role focused on AI/ML and inference products
• Strong understanding of production AI inference, including model serving and observability
• Credibility with engineering leaders and comfort in technical discussions with platform engineering buyers

Responsibilities

• Own product strategy, roadmap, and lifecycle for AI inference and model serving
• Lead technical discovery with enterprise teams, translating findings into prioritized requirements
• Drive go-to-market execution, including pricing, packaging, and direct engagement with customers and partners

Skills

AI/ML product management

Product lifecycle

Technical discovery

Engineering collaboration

Observability

Tools

Inference runtimes

Observability tooling

GPU optimization

Model serving

Job description

# Product Manager - AI InferenceVirtualVocationsAlexandria, USFull-time## About the RoleOwning the product strategy and lifecycle for AI inference and model serving, the full-time Product Manager - AI Inference will lead technical discovery and collaborate with engineering teams to optimize performance across GPU, network, and storage infrastructures in a remote environment. Key responsibilities Own product strategy, roadmap, and lifecycle for inference and model serving, including serverless inference and autoscaling Lead technical discovery with NeoClouds and enterprise teams, translating findings into prioritized requirements Drive go-to-market execution, including pricing, packaging, and direct engagement with customers and partners Required qualifications 7+ years in product management or a senior technical role focused on AI/ML and inference products Strong understanding of production AI inference, including model serving and observability Proven ability to evaluate performance trade-offs across GPU, network, and storage layers Working knowledge of modern inference runtimes and optimization patterns in production Credibility with engineering leaders and comfort in technical discussions with platform engineering buyersApply on Company Site### Apply for this PositionFill out the form below to apply for this rolePDF or Word document, max 10MBBy submitting this application, you agree to your information being shared with the hiring team.### About the CompanyVirtualVocations### Job DetailsJob TypeFull-timeLocationAlexandria, USReferenceEXT-MPPFZC3F-S365Posted28 May 2026