Lead, Inference Infrastructure & Fleet

Anthropic; San Francisco (CA); Hybrid; USD 405,000 - 625,000; Full time

Benefits offered by this job

Competitive compensation

Equity donation matching

Generous vacation and parental leave

Flexible working hours

SF office space

Job summary

Anthropic in San Francisco is seeking a senior Engineering Manager to lead ML platform, infrastructure, and distributed‑systems engineers responsible for the inference fleet and related control planes.

You will set architectural direction, own cross‑team roadmaps, hire and develop leaders, and ensure reliability, latency, and cost efficiency as models and clouds evolve. This role is pivotal to scaling Anthropic's safe, steerable AI.

Qualifications

• Engineering mgmt experience leading critical-path production infrastructure at scale.
• Deep systems background: load balancing, scheduling, cluster orchestration, autoscaling, high-performance networking.
• Experience shipping performance/efficiency improvements in large-scale systems with measurable impact.
• Experience running production infrastructure with on-call, incident response, and deployment discipline.
• Results-oriented, impact-driven approach across throughput, latency, cost, and reliability trade-offs.
• Ability to build strong cross-team relationships in a seam role.
• Curiosity about machine learning systems and transformer inference mechanics.

Responsibilities

• Own the technical roadmap for how the inference fleet is coordinated and how capacity and caches are managed.
• Partner with product, inference engine, performance, and capacity teams to deliver measurable throughput and latency improvements.
• Build a habit of quantitative modeling and ship only after measuring expected gains.

Skills

Engineering management

System architecture

Performance optimization

Production operations

Results driven

Cross-team collaboration

ML curiosity

Tools

Kubernetes

Job description

Anthropic in San Francisco is seeking a senior Engineering Manager to lead ML platform, infrastructure, and distributed‑systems engineers responsible for the inference fleet and related control planes.

You will set architectural direction, own cross‑team roadmaps, hire and develop leaders, and ensure reliability, latency, and cost efficiency as models and clouds evolve. This role is pivotal to scaling Anthropic's safe, steerable AI.