Senior Inference Systems Engineer

Anthropic Limited; City Of London; Hybrid; GBP 325,000 - 390,000; Full time

Job summary

Anthropic is seeking an experienced engineer to join the Inference team, building and maintaining distributed systems that power Claude for millions of users worldwide. You will design scalable routing, orchestration, and performance-optimized infrastructure across cloud platforms.

The role emphasizes production-grade pipelines, real-time adaptability, and collaboration with researchers to advance steerable AI. Hybrid office policy applies in the UK.

Qualifications

• Proficiency in Python or Rust.
• Software engineering experience building and operating distributed systems in production.
• Working knowledge of containerized infrastructure (e.g., Kubernetes) and at least one major cloud platform (AWS, GCP, or Azure).
• Results-oriented with a bias towards flexibility and impact.
• Willingness to pick up slack outside job description and to learn ML systems.

Responsibilities

• Design, build, and maintain the distributed systems that serve Claude to millions of users worldwide.
• Develop resilient, flexible systems that adapt in real time to real-world events.
• Develop intelligent request routing, load balancing, and traffic management across thousands of accelerators.
• Maximize compute efficiency with autoscaling and orchestration of production, research, and experimental workloads.
• Build and operate production-grade deployment pipelines for releasing new models.
• Provide high-performance inference infrastructure enabling researchers to develop next-generation models.
• Integrate new AI accelerator platforms and support inference for new model architectures.

Skills

Python

Rust

Distributed systems

Kubernetes

Cloud platforms

Education

Bachelor's degree

Tools

Docker

AWS

GCP

Azure

Job description

Anthropic is seeking an experienced engineer to join the Inference team, building and maintaining distributed systems that power Claude for millions of users worldwide. You will design scalable routing, orchestration, and performance-optimized infrastructure across cloud platforms.

The role emphasizes production-grade pipelines, real-time adaptability, and collaboration with researchers to advance steerable AI. Hybrid office policy applies in the UK.