Staff Software Engineer, Large-Scale Inference

Anthropic; Greater London; Hybrid; GBP 80,000 - 100,000; Full time

Benefits offered by this job

Competitive compensation

Generous vacation

Flexible working hours

Job summary

A leading AI research organization in the UK is seeking a Staff Software Engineer to join its Inference team. In this role, you will optimize systems that serve AI models to millions of users, focusing on infrastructure for breakthrough AI research. Candidates should have significant experience in software engineering, especially with distributed systems, and may possess familiarity with performance optimization and cloud infrastructure. This position offers competitive compensation and a collaborative working environment.

Qualifications

• Significant software engineering experience, particularly with distributed systems.
• Results-oriented, with a bias towards flexibility and impact.
• Eager to learn more about machine learning systems and infrastructure.

Responsibilities

• Work end to end on infrastructure to serve Claude to millions of users.
• Optimize performance for AI research.
• Implement intelligent routing algorithms for request distribution.

Skills

Performance optimization

Distributed systems

Large-scale service orchestration

Intelligent request routing

Python or Rust

Education

Bachelor’s degree in a related field

Tools

Kubernetes

AWS

GCP

Job description

A leading AI research organization in the UK is seeking a Staff Software Engineer to join its Inference team. In this role, you will optimize systems that serve AI models to millions of users, focusing on infrastructure for breakthrough AI research. Candidates should have significant experience in software engineering, especially with distributed systems, and may possess familiarity with performance optimization and cloud infrastructure. This position offers competitive compensation and a collaborative working environment.