Product Manager, Compute Platform

Visa Hunt

San Francisco (CA)

Hybrid

USD 305,000 - 385,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Anthropic is seeking a Product Manager focused on the Compute Platform to partner with Infrastructure, Compute Operations, Engineering, Finance & Strategy, and Research. You will shape scheduling, capacity management, preemption and fairness frameworks, quota systems, and observability tooling for a growing GPU/accelerator compute fleet.

You will define and own the strategy and roadmap for job scheduling primitives, capacity allocation, and performance guarantees, impacting utilization, latency,

Qualifications

  • 7+ years of product management experience in compute infrastructure or scheduling.
  • Experience taking infrastructure products from infancy to scale for internal/external customers.
  • Ability to balance utilization, latency, cost, and fairness while communicating decisions.

Responsibilities

  • Define the semantic layer for job scheduling, prioritization, and resource classes.
  • Drive roadmap for compute capacity management, quota systems, and fairness policies.
  • Collaborate with engineering and leadership to ensure efficient cluster utilization and cost control.
  • Build observability tools and dashboards for real-time resource visibility.

Skills

PM experience
Compute infra
Scheduling
Cross-functional
Strategic thinking

Education

Bachelor’s degree

Tools

Kubernetes
Slurm
Borg
YARN

Job description

About Anthropic

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

About the role

As a Product Manager focused on Compute Platform, you’ll partner with Infrastructure, Compute Operations, Engineering, Finance & Strategy, and Research to build the scheduling, orchestration, and capacity management systems that power Anthropic’s compute infrastructure—the foundation on which every model training run, evaluation, and inference workload depends:

  • Partner with Infrastructure to build the systems that determine how jobs are scheduled, prioritized, and allocated across Anthropic’s growing fleet of GPU and accelerator clusters—ensuring the right workloads run on the right hardware at the right time.
  • Your work directly impacts cluster utilization, cost efficiency, and researcher velocity: defining the semantic layer for job scheduling, establishing resource guarantees, and making the trade-offs that keep our infrastructure running at peak capacity.
  • You’ll drive the evolution of our compute platform to support increasingly diverse workloads—from large-scale training runs and fine‑tuning jobs to real‑time inference and batch evaluation—each with distinct scheduling requirements, priority levels, and resource profiles.
  • You will define and own the strategy and roadmap across job scheduling primitives, capacity allocation policies, preemption and fairness frameworks, quota management, and the observability tooling that gives engineering and leadership confidence in how compute resources are being used.
Responsibilities
  • Deeply understand the needs of internal customers across Research, Infrastructure, Product, and Finance—from researchers who need guaranteed resources for multi‑week training runs to platform teams managing inference workloads with strict latency SLAs.
  • Define and iterate on the semantic layer for job scheduling: the abstractions, priority tiers, resource classes, and preemption policies that govern how work flows through our compute clusters.
  • Partner with engineering leads to design scheduling capabilities that maximize cluster utilization while honoring resource guarantees—ensuring jobs have the right prerequisites (data, checkpoints, hardware affinity) validated before launch to avoid wasted compute.
  • Drive product strategy and roadmap for compute capacity management, including quota systems, fairness policies, bin‑packing optimizations, and gang‑scheduling for distributed workloads.
  • Own the trade‑off framework between utilization efficiency, job latency, cost, and reliability—making transparent prioritization decisions and communicating them clearly to senior leadership.
  • Collaborate with the Capacity Strategy & Operations team on capacity planning models, demand forecasting, and cost‑to‑serve analytics that inform infrastructure investment decisions.
  • Build and champion observability tools and dashboards that provide real‑time visibility into cluster health, queue depth, scheduling efficiency, and resource waste.
You may be a good fit if you have
  • 7+ years of product management experience, with deep exposure to compute infrastructure, distributed systems, or scheduling/orchestration platforms.
  • Experience taking technical infrastructure products from infancy to scale—you’ve built something from the ground up and grown it to serve demanding internal or external customers.
  • Track record of building platform products that balance the needs of multiple users and stakeholders—you’re comfortable making prioritization trade‑offs between utilization, latency, cost, and fairness, and communicating them clearly.
  • Ability to internalize complex technical systems (job schedulers, cluster managers, resource orchestrators) and translate that understanding into a comprehensive product vision.
  • Fluent across functions—you’re equally credible discussing scheduling algorithms with engineers, capacity economics with finance, and infrastructure strategy with leadership.
  • Strong instinct for connecting technical decisions to business outcomes: every percentage point of cluster utilization has measurable impact.
  • Scrappy and resourceful—you do what it takes to get things done in a fast‑moving environment.
Strong candidates may have
  • Built or scaled job scheduling, resource orchestration, or workload management systems for large‑scale compute clusters (e.g., Kubernetes, Slurm, Borg, YARN, or custom schedulers).
  • Deep familiarity with GPU/accelerator scheduling challenges, including gang‑scheduling, topology‑aware placement, preemption, and hardware affinity constraints.
  • Experience defining and enforcing SLAs and resource guarantees for compute workloads—including mechanisms to validate job prerequisites (data readiness, checkpoint availability, hardware compatibility) before scheduling to avoid wasted resources.
  • Capacity planning experience across cloud and on‑premises infrastructure, including cost modelling, demand forecasting, and vendor management for compute procurement.
  • Scaled through hypergrowth in compute‑intensive environments (AI/ML, HPC, large‑scale cloud infrastructure).
  • Experience with observability and efficiency tooling for distributed infrastructure—building dashboards, automation, and governance workflows that drive utilization and cost accountability.
Logistics

Minimum education: Bachelor's degree or an equivalent combination of education, training, and/or experience.

Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience.

Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position.

Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.

Visa sponsorship: We do sponsor visas! However, we aren’t able to successfully sponsor visas for every role and every candidate. If we make you an offer, we will make every reasonable effort to get you a visa.

Annual Salary

Annual Salary: $305,000 — $385,000 USD.

Come work with us!

Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.

Guidance on Candidates' AI Usage

Learn about our policy for using AI in our application process.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Product Manager, Compute Platform
Product Manager, Compute Platform

Neura Market • San Francisco (CA)

Hybrid
USD 305,000 - 385,000
Competitive compensation
Optional equity donation matching
Generous vacation and parental leave
+2
Technical Program Manager, Compute
Technical Program Manager, Compute

Anthropic • San Francisco (CA)

Hybrid
USD 365,000 - 435,000
Competitive compensation
Generous vacation and parental leave
Flexible working hours
+1
Technical Program Manager, Compute
Technical Program Manager, Compute

Anthropic • Seattle (WA)

Hybrid
USD 365,000 - 435,000
Competitive compensation
Generous vacation and parental leave
Flexible working hours
Technical Program Manager, Compute San Francisco, CA | New York City, NY | Seattle, WA
Technical Program Manager, Compute San Francisco, CA | New York City, NY | Seattle, WA

Anthropic • San Francisco (CA)

Hybrid
USD 290,000 - 365,000
AI Infrastructure Operations, Demand Planning
AI Infrastructure Operations, Demand Planning

AI Chopping Block • New York (NY)

Hybrid
USD 320,000 - 405,000
Technical Program Manager, Hardware Systems
Technical Program Manager, Hardware Systems

Anthropic • New York (NY)

Hybrid
USD 365,000 - 435,000
Equity donation matching
Generous vacation & parental leave
Flexible working hours
Technical Program Manager, Hardware Systems
Technical Program Manager, Hardware Systems

AI Chopping Block • San Francisco (CA)

Hybrid
USD 365,000 - 435,000
Competitive compensation
Equity donation matching
Generous vacation and parental leave
+2
Staff+ Software Engineer, Kubernetes Platform
Staff+ Software Engineer, Kubernetes Platform

Anthropic • New York (NY)

On-site
USD 320,000 - 485,000
Product Manager, Multi-Cloud Growth - Google
Product Manager, Multi-Cloud Growth - Google

Anthropic • San Francisco (CA)

On-site
USD 305,000 - 385,000
Competitive compensation
Generous vacation
Flexible working hours
Technical Program Manager, Hardware Systems
Technical Program Manager, Hardware Systems

Anthropic Limited • San Francisco (CA)

On-site
USD 365,000 - 435,000