Technical Program Manager, Inference

EngineersOfAI; San Francisco (CA); On-site; USD 180,000 - 260,000; Full time

Job summary

Anthropic is seeking a Technical Program Manager to drive end-to-end programs that scale Claude’s serving fleet across accelerator and cloud platforms. You will own capacity planning, reliability initiatives, and cross-team collaboration with Research, Safeguards, Security, Compute, Infrastructure, and API teams.

You’ll lead velocity improvements, manage tooling and CI/CD, and ensure production readiness for model launches, balancing cost, latency, and reliability in a fast-moving frontier AI

Qualifications

• 7+ years of experience in TPM or equivalent leadership role, owning large multi-team infrastructure programs end to end in production distributed systems, ML infrastructure, or cloud platforms.

Responsibilities

• Own programs that scale Claude’s serving fleet across accelerator and cloud platforms, from early direction through delivery.
• Drive new capacity online end to end, coordinating across compute, infrastructure, security, networking, and inference teams.

Skills

Program management

Cross-team coordination

ML infrastructure

Production distributed systems

Cloud platforms

Job description

About Anthropic

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

About the role

Anthropic’s Inference organization serves Claude to millions of users and enterprise customers, across our own products and the world’s largest cloud platforms, with the speed, reliability, and efficiency that frontier AI demands. The stack that makes this possible is deep and tightly coupled: accelerator kernels, an in-house inference engine that manages the entire token path for both production and research workloads, distributed routing, autoscaling, and capacity management. Every layer affects the others, often in ways that are hard to see in isolation. We build across GPUs, TPUs, and Trainium, and the complexity of building, testing, and shipping inference software grows with every platform we add.

We're looking for a Technical Program Manager to drive the programs that scale it. The work spans four closely coupled areas:

• Scaling and infrastructure. Routing, autoscaling, and capacity management for the serving fleet, and bringing new capacity online.

• Velocity. The toolchains, development environments, and CI/CD that let inference engineers build, test, and ship across every accelerator platform.

• Inference engine. The software between the accelerator kernels and the routing layer that serves every request.

• Performance. Improving throughput, latency, cost, and reliability across the stack, with correctness treated as part of performance.

This is not a status-tracking role. You'll own outcomes end to end, often where no single team is accountable for the whole picture. Much of your value comes from crossing boundaries into Research, Safeguards, Security, Compute, Infrastructure, API, and our cloud and silicon partners, and bringing back the requirements and dependencies that no team sees from inside its own space. There is little process to inherit, and we want to keep it that way: you'll build the minimum machinery the work needs and remove it when it stops helping. And because this is Anthropic, you'll have Claude as a collaborator. We expect TPMs on this team to push hard on what AI-assisted program management and fleet operations can look like.

Key responsibilities

• Own the programs that scale Claude’s serving fleet across accelerator and cloud platforms, from early direction through delivery.

• Drive new capacity online end to end, working across compute, infrastructure, security, networking, and inference teams so one person is accountable for the whole path.

• Build visibility into supply, demand, and utilization with capacity and finance partners, and drive trade-offs among utilization, cost, latency, and reliability to a clear decision.

• Lead reliability programs and large migrations without disrupting production traffic or research, and make sure incident follow-ups land in team roadmaps.

• Drive the programs that make inference engineers faster: define the productivity metrics that matter, find the bottlenecks, and improve how software is built, tested, and released across platforms, in step with Anthropic’s central Infrastructure org.

• Coordinate roadmaps and priorities across the production, research, and safeguards needs that depend on the same teams.

• Track performance and efficiency work from opportunity to measured impact in production, with correctness held as a release criterion.

• Own inference readiness for model launches alongside our launch TPMs.

Minimum qualifications

• 7+ years of experience as a TPM, or in an equivalent engineering or SRE lead role, owning large multi-team infrastructure programs end to end in production distributed systems, ML infrastructure, or cloud platforms. You can speak to the outcomes in detail, incl