AI Systems Product Manager — Data & Inference Platform

Alluxio, Inc.

Foster City (CA)

On-site

USD 190,000 - 240,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Competitive compensation
Equity package
Comprehensive benefits
Collaborative environment

Job summary

A leading data orchestration company is seeking a Technical Product Manager to shape its AI systems strategy. This role involves defining the vision for AI data platforms and optimizing systems for high throughput and low latency. Candidates should have 5–9 years of experience in product management within AI infrastructure and a deep understanding of AI/ML workflows. The position offers competitive compensation, equity, and a comprehensive benefits package, emphasizing collaboration with top engineers and researchers.

Qualifications

  • 5–9 years of experience in product management or technical leadership within AI.
  • Strong understanding of AI/ML workflows.
  • Proven track record of delivering infrastructure features.
  • Technical fluency with distributed systems and cloud orchestration.
  • Exceptional communication and strategic thinking abilities.

Responsibilities

  • Define the long-term vision and roadmap for the AI data platform.
  • Collaborate with engineering to design features for high-throughput data access.
  • Ensure seamless integration with AI frameworks.
  • Engage directly with enterprise AI teams to validate impact.
  • Stay ahead of trends and translate them into actionable product plans.

Skills

Product management in AI infrastructure
Understanding of AI/ML workflows
Infrastructure features delivery
Technical fluency in distributed systems
Communication and strategic thinking

Tools

Kubernetes
AWS/GCP/Azure
PyTorch
TensorFlow
Triton
Ray
LangChain

Job description

A leading data orchestration company is seeking a Technical Product Manager to shape its AI systems strategy. This role involves defining the vision for AI data platforms and optimizing systems for high throughput and low latency. Candidates should have 5–9 years of experience in product management within AI infrastructure and a deep understanding of AI/ML workflows. The position offers competitive compensation, equity, and a comprehensive benefits package, emphasizing collaboration with top engineers and researchers.
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Product Manager, AI Platform & ML Infra
Senior Product Manager, AI Platform & ML Infra

Databricks • San Francisco (CA)

Hybrid
USD 180,000 - 248,000
Technical Product Manager: AI Infrastructure & Scale
Technical Product Manager: AI Infrastructure & Scale

Amadeus Search • San Francisco (CA)

On-site
USD 140,000 - 200,000
Equity
Performance bonuses
Medical, dental, and vision coverage
+2
Product Manager, AI Infrastructure & Open Systems
Product Manager, AI Infrastructure & Open Systems

RadixArk • Palo Alto (CA)

On-site
USD 100,000 - 140,000
Competitive salary and equity package
Work with a world-class team
Direct impact on future of AI infrastructure
AI Platform Product Lead
AI Platform Product Lead

Databricks Inc. • Seattle (WA)

On-site
USD 171,000 - 236,000
Comprehensive benefits
Annual performance bonus
Equity options
AI Platform Product Lead — Scale ML Infrastructure
AI Platform Product Lead — Scale ML Infrastructure

Databricks • Seattle (WA)

Remote
USD 171,000 - 236,000
AI Platform Product Manager – Enterprise ML
AI Platform Product Manager – Enterprise ML

Databricks Inc. • San Francisco (CA)

On-site
USD 180,000 - 248,000
Comprehensive benefits
Equity options
Annual performance bonus
AI Platform Product Manager — Scale Production ML
AI Platform Product Manager — Scale Production ML

Menlo Ventures • San Francisco (CA)

Hybrid
USD 180,000 - 248,000
Flexible working hours
Health insurance
Equity options
Group Product Manager, Managed Inference & AI Cloud
Group Product Manager, Managed Inference & AI Cloud

Crusoe Energy Systems LLC • San Francisco (CA)

On-site
USD 233,000 - 282,000
Industry competitive pay
Restricted Stock Units
Health insurance options
+6
AI Product Manager — Strategy & Scale for ML Platforms
AI Product Manager — Strategy & Scale for ML Platforms

MicroAI • Irving (TX)

On-site
USD 100,000 - 130,000
Lead AI & Data Platform Product Manager
Lead AI & Data Platform Product Manager

WSS Associates • United States

On-site
USD 170,000 - 220,000