Senior Product Manager, ML Infra & Model Optimization

Amazon.com

Seattle (WA)

On-site

USD 151,000 - 205,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

RSUs
Health insurance
Comprehensive benefits

Job summary

Amazon seeks a Senior Product Manager – Technical to own the vision and roadmap for MARS, a hardware-agnostic platform for optimizing, benchmarking, and containerizing LLMs across heterogeneous compute. You will define a multi-year strategy, partner with science and engineering to expand capabilities, and own key business metrics.

The ideal candidate thrives at the intersection of ML infrastructure, cost optimization, and cross-org influence, turning ambiguity into measurable outcomes.

Qualifications

  • 5+ years of product or program management, product marketing, business development or technology experience.
  • Bachelor's degree.
  • Experience with feature delivery and tradeoffs of a product.
  • Experience owning/driving roadmap strategy and definition.
  • Experience with end to end product delivery.
  • Experience contributing to engineering discussions around technology decisions and strategy related to a product.

Responsibilities

  • Define and drive the multi-year MARS product roadmap, translating cost-optimization and capacity goals into prioritized, measurable deliverables.
  • Partner with science and engineering to expand MARS capabilities—new hardware backends, quantization and distillation techniques, and automated benchmarking.
  • Work backwards from internal customers to identify high-leverage optimization opportunities and unblock adoption.
  • Establish the MARS operating model, intake process, and prioritization framework to scale the platform as a shared service.
  • Own key business metrics—cost per million tokens, GPU/accelerator utilization, throughput, and realized IMR savings—and report progress to senior leadership.
  • Drive cross-org alignment across partner teams and lead the roadmap workshop cadence.
  • Manage stakeholder communication, technical trade-offs, and go/no-go decisions across the platform lifecycle.

Skills

Product management
Roadmap strategy
Cross-functional leadership
Engineering collaboration
Cost optimization
AI/ML awareness

Education

Bachelor's degree

Job description

Amazon seeks a Senior Product Manager – Technical to own the vision and roadmap for MARS, a hardware-agnostic platform for optimizing, benchmarking, and containerizing LLMs across heterogeneous compute. You will define a multi-year strategy, partner with science and engineering to expand capabilities, and own key business metrics.

The ideal candidate thrives at the intersection of ML infrastructure, cost optimization, and cross-org influence, turning ambiguity into measurable outcomes.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Technical PM, AI/ML Infra & Cost Optimization
Senior Technical PM, AI/ML Infra & Cost Optimization

Amazon Inc. • Seattle (WA)

On-site
USD 160,000 - 210,000
Sr. Product Manager, Technical, Amazon Selection and Catalog Systems
Sr. Product Manager, Technical, Amazon Selection and Catalog Systems

Amazon Inc. • Seattle (WA)

On-site
USD 160,000 - 210,000
Sr. Product Manager, Technical, Amazon Selection and Catalog Systems
Sr. Product Manager, Technical, Amazon Selection and Catalog Systems

Amazon.com • Seattle (WA)

On-site
USD 151,000 - 205,000
RSUs
Health insurance
Comprehensive benefits
Senior Manager, AI Compute Platform & ML Systems
Senior Manager, AI Compute Platform & ML Systems

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 220,000 - 298,000
Health insurance
401(k) matching
Senior Product Manager, ML Lead Qualification
Senior Product Manager, ML Lead Qualification

Amazon Inc. • Seattle (WA)

On-site
USD 151,000 - 205,000
RSUs
Health insurance
401(k) matching
+1
Senior Product Manager — AI/ML Compute & Accelerated GPUs
Senior Product Manager — AI/ML Compute & Accelerated GPUs

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 152,000 - 206,000
Health insurance
RSUs
401(k) matching
+2
Senior Product Manager, ML Lead Qualification for Marketing
Senior Product Manager, ML Lead Qualification for Marketing

Amazon Web Services (AWS) • New York (NY)

On-site
USD 166,000 - 225,000
Health insurance
401(k) matching
Paid time off
+1
Senior Product Leader, AI Foundations & Orchestration
Senior Product Leader, AI Foundations & Orchestration

Amazon Inc. • Seattle (WA)

On-site
USD 150,000 - 190,000
Senior ML Infrastructure Engineer - GenAI & Scale
Senior ML Infrastructure Engineer - GenAI & Scale

Amazon Inc. • Seattle (WA)

On-site
USD 168,000 - 227,000
Health insurance
401(k) matching
Paid time off
+1
Senior ML Platform Engineer - MLOps & AWS
Senior ML Platform Engineer - MLOps & AWS

BetMGM • Tennessee

On-site
USD 117,000 - 156,000
Medical insurance
Dental insurance
Vision insurance
+10