Technical Program Manager, AI Inference & Fleet Scale

Candidate; San Francisco (CA); Hybrid; USD 290,000 - 435,000; Full time

Benefits offered by this job

Competitive compensation

Equity donation matching (optional)

Generous vacation and parental leave

Flexible working hours

SF office space

Job summary

Anthropic in San Francisco is seeking a Technical Program Manager to drive end-to-end programs that scale Claude across accelerator and cloud platforms. You will own capacity planning, routing, and reliability improvements across teams.

You’ll collaborate with Research, Safeguards, Compute, Infrastructure, API, and partners to deliver scalable, cost-efficient deployments and migrations without disrupting production. A track record leading multi-team infrastructure programs is essential.

Qualifications

• 7+ years leading large multi-team infrastructure programs in production distributed systems or cloud platforms.
• Technical fluency in large-scale serving infrastructure, including routing, load balancing, autoscaling, deployment and observability.
• Understanding of how LLM inference uses hardware and fast-moving technical domains.
• Experience building program mechanisms from scratch in ambiguous, fast-moving efforts.
• Ability to drive outcomes across organizations with competing priorities and unclear ownership.
• Strong written communication and ability to update executives and teams.

Responsibilities

• Own the programs that scale Claude’s serving fleet across accelerator and cloud platforms from direction to delivery.
• Drive capacity online end to end, coordinating across compute, infrastructure, security, networking, and inference teams.
• Build visibility into supply, demand, and utilization; trade off cost, latency, and reliability for clear decisions.
• Lead reliability programs and large migrations without disrupting production or research.
• Define productivity metrics and remove bottlenecks to speed up how software is built and released.
• Coordinate roadmaps across production, research, and safeguards needs.
• Track performance and efficiency from opportunity to measurable impact in production.
• Own inference readiness for model launches with launch TPMs.

Skills

Program management

Distributed systems

Cloud platforms

Leadership

Technical communication

Cross-functional collaboration

Ownership mindset

Education

Bachelor’s degree or equivalent

Tools

Kubernetes

CI/CD

Observability tooling

Job description

Anthropic in San Francisco is seeking a Technical Program Manager to drive end-to-end programs that scale Claude across accelerator and cloud platforms. You will own capacity planning, routing, and reliability improvements across teams.

You’ll collaborate with Research, Safeguards, Compute, Infrastructure, API, and partners to deliver scalable, cost-efficient deployments and migrations without disrupting production. A track record leading multi-team infrastructure programs is essential.