Staff Software Engineer, AI Inference & Distributed Systems

anthropic; Greater London; Hybrid; GBP 325,000 - 390,000; Full time

Job summary

Anthropic is hiring for a role within the Inference team to design and operate the distributed systems that serve Claude to millions globally. You will work on high-performance infrastructure, intelligent request routing, and production-grade deployment pipelines.

The role emphasizes scalable compute, multi-region deployments, and integration with AI accelerator platforms. The team handles real-time adaptation to events, supports researchers, and collaborates to advance steerable, trustworthy AI

Qualifications

• Proficiency in Python or Rust.
• Software engineering experience building and operating distributed systems in production.
• Working knowledge of containerized infrastructure (e.g., Kubernetes) and at least one major cloud platform (AWS, GCP, or Azure)
• Results-oriented, with a bias towards flexibility and impact
• Willingness to pick up slack, even if it goes outside your job description
• Desire to learn more about machine learning systems and infrastructure
• Thrive in environments where technical excellence directly drives both business results and research breakthroughs
• Care about the societal impacts of your work

Responsibilities

• Design, build, and maintain the distributed systems that serve Claude to millions of users worldwide
• Develop resilient, flexible systems that adapt in real time to real-world events
• Develop intelligent request routing, load balancing, and traffic management systems across thousands of accelerators
• Maximize compute efficiency across the fleet by autoscaling and orchestrating production, research, and experimental workloads
• Build and operate production-grade deployment pipelines for releasing new models to users
• Provide high-performance inference infrastructure that enables researchers to develop next-generation models
• Integrate new AI accelerator platforms and support inference for new model architectures
• Represented projects: Design intelligent routing algorithms, autoscaling compute fleet, production deployment pipelines, observability to tune performance, multi-region deployments

Skills

Python

Rust

Distributed systems

Kubernetes

Cloud platforms (AWS/GCP/Azure)

Education

Bachelor's degree

Tools

Kubernetes

AWS

GCP

Azure

Job description

Anthropic is hiring for a role within the Inference team to design and operate the distributed systems that serve Claude to millions globally. You will work on high-performance infrastructure, intelligent request routing, and production-grade deployment pipelines.

The role emphasizes scalable compute, multi-region deployments, and integration with AI accelerator platforms. The team handles real-time adaptation to events, supports researchers, and collaborates to advance steerable, trustworthy AI