Technical Program Manager: AI Inference & Fleet Scale

Anthropic

Seattle (WA)

On-site

USD 290,000 - 435,000

Full time

6 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Generous vacation and parental leave
Flexible working hours
Equity donation matching
Office space

Job summary

Anthropic is seeking a Technical Program Manager to drive the programs that scale Claude’s serving fleet across accelerator and cloud platforms. You will own end-to-end delivery across compute, infrastructure, security, networking, and inference teams.

You will lead capacity initiatives, build visibility into supply and demand, and optimize for cost, latency, and reliability while aligning with Research, Safeguards, and Infrastructure groups.

Qualifications

  • 7+ years of TPM experience owning large multi-team infrastructure programs in production distributed systems, ML infra, or cloud.
  • Technical fluency in large-scale serving infra: routing, autoscaling, observability, deployment, and rollout.
  • Understanding of how LLM inference uses hardware or quick adaptability to new technical domains.

Responsibilities

  • Own programs that scale Claude’s serving fleet across accelerator and cloud platforms, from direction to delivery.
  • Drive capacity online end to end across compute, infrastructure, security, networking, and inference teams.
  • Build visibility into supply, demand, and utilization with capacity and finance partners; trade off utilization, cost, latency, and reliability.

Skills

7+ years TPM
Distributed systems
LLM inference hardware
Cross-org leadership
Executive communication

Education

Bachelor’s degree or equivalent

Job description

Anthropic is seeking a Technical Program Manager to drive the programs that scale Claude’s serving fleet across accelerator and cloud platforms. You will own end-to-end delivery across compute, infrastructure, security, networking, and inference teams.

You will lead capacity initiatives, build visibility into supply and demand, and optimize for cost, latency, and reliability while aligning with Research, Safeguards, and Infrastructure groups.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Technical Program Manager - AI Inference & Fleet Scale
Technical Program Manager - AI Inference & Fleet Scale

EngineersOfAI • San Francisco (CA)

On-site
USD 180,000 - 260,000
Technical Program Manager, AI Inference & Fleet Scale
Technical Program Manager, AI Inference & Fleet Scale

Candidate • San Francisco (CA)

Hybrid
USD 290,000 - 435,000
Competitive compensation
Equity donation matching (optional)
Generous vacation and parental leave
+2
Strategic TPM for AI Inference & Fleet
Strategic TPM for AI Inference & Fleet

Anthropic • San Francisco (CA)

Hybrid
USD 290,000 - 435,000
Generous vacation
Parental leave
Flexible working hours
+1
Engineering Manager - AI Infrastructure & Platforms
Engineering Manager - AI Infrastructure & Platforms

Anthropic • Seattle (WA)

Hybrid
USD 405,000 - 625,000
Competitive compensation
Equity matching
Parental leave
+2
Technical Program Manager, Inference
Technical Program Manager, Inference

EngineersOfAI • San Francisco (CA)

On-site
USD 180,000 - 260,000
Senior Staff Software Engineer, AI Inference & Scale
Senior Staff Software Engineer, AI Inference & Scale

Anthropic • Seattle (WA)

On-site
USD 180,000 - 280,000
Comprehensive health, dental, and eye/
Relocation support
Annual education stipend
+2
AI Inference Scale TPM: Reliability & Velocity
AI Inference Scale TPM: Reliability & Velocity

Anthropic • San Francisco (CA), New York (NY)

Hybrid
USD 290,000 - 435,000
Staff & Senior Software Engineer – Scalable AI Inference
Staff & Senior Software Engineer – Scalable AI Inference

Anthropic • San Francisco (CA)

On-site
USD 320,000 - 485,000
Competitive pay
Equity matching
Generous vacation
+3
Senior/Staff Software Engineer — Scalable AI Inference Systems
Senior/Staff Software Engineer — Scalable AI Inference Systems

EngineersOfAI • New York (NY)

On-site
USD 180,000 - 280,000
Senior Staff Engineer, Distributed Inference Systems
Senior Staff Engineer, Distributed Inference Systems

Anthropic Limited • New York (NY)

Hybrid
USD 320,000 - 485,000