Staff AI Inference Systems Engineer

Mat Vin; Greater London; Hybrid; GBP 325,000 - 390,000; Full time

Benefits offered by this job

Competitive compensation

Equity donation matching

Generous vacation and parental leave

Flexible working hours

Office space

Job summary

Anthropic in London, UK, is hiring a Staff Software Engineer for Inference to build scalable, high-performance distributed systems. You will work across the stack to serve Claude to millions of users, manage real-time workloads, and optimize inference infrastructure.

The role emphasizes Python or Rust proficiency, containerized environments (Kubernetes), and cloud platforms (AWS, GCP, Azure) within a hybrid office setting. Visa sponsorship available for capable candidates.

Qualifications

• Experience designing and building large-scale distributed systems.
• Proficiency in modern programming languages and systems software.
• Experience operating in production-grade distributed inference infrastructure.

Responsibilities

• Design, build, and maintain distributed systems serving Claude to millions of users.
• Develop resilient, real-time adaptive systems for real-world events.
• Develop intelligent routing, load balancing, and traffic management across accelerators.
• Maximize compute efficiency via autoscaling and orchestration of workloads.
• Build and operate production-grade deployment pipelines for models.
• Provide high-performance inference infrastructure for research and development.
• Integrate new AI accelerator platforms and support new model architectures.
• Demonstrate proficiency in Python or Rust.

Skills

Python

Rust

Distributed systems

Kubernetes

AWS

GCP

Azure

Software engineering

Education

Bachelor0s degree

Tools

Python

Job description

Anthropic in London, UK, is hiring a Staff Software Engineer for Inference to build scalable, high-performance distributed systems. You will work across the stack to serve Claude to millions of users, manage real-time workloads, and optimize inference infrastructure.

The role emphasizes Python or Rust proficiency, containerized environments (Kubernetes), and cloud platforms (AWS, GCP, Azure) within a hybrid office setting. Visa sponsorship available for capable candidates.