Performance Engineer

Anthropic; York and North Yorkshire; On-site; GBP 110,000 - 150,000; Full time

Benefits offered by this job

Health insurance

Fertility benefits

Parental leave 22 weeks

Flexible PTO

Mental health support

Equity package

Equity donation matching

Retirement plans

Life and income protection

Wellness stipend

Commuter benefits

Education stipend

Home office stipend

Relocation support

In-office meals

Job summary

Anthropic in the United Kingdom is seeking a Performance Engineer to identify novel systems problems and build high-throughput, low-latency distributed services for large language models. You will implement sampling, GPU kernel adaptations for low-precision inference, custom load-balancing, and fault-tolerant architectures, collaborating with teams to maximize throughput and reliability.

This role requires deep systems expertise at supercomputing scale and a readiness to pair-program and own

Qualifications

• Significant software engineering or ML experience, especially at scale.
• Experience solving large-scale systems problems.
• Interest in ML and societal impact, with results-driven mindset.

Responsibilities

• Implement low-latency high-throughput sampling for large language models.
• Implement GPU kernels to adapt models to low-precision inference.
• Write a custom load-balancing algorithm to optimize serving efficiency.
• Build quantitative models of system performance.
• Design and implement fault-tolerant distributed systems with complex networks.
• Debug kernel-level network latency spikes in containerized environments.

Skills

Low-latency systems

GPU kernel programming

Distributed systems

Load balancing

Kernel debugging

Performance modeling

Tools

Docker

Kubernetes

Job description

• Running machine learning (ML) algorithms at our scale often requires solving novel systems problems
• As a Performance Engineer, you’ll be responsible for identifying these problems, and then developing systems that optimize the throughput and robustness of our largest distributed systems
• Implement low-latency high-throughput sampling for large language models
• Implement GPU kernels to adapt our models to low-precision inference
• Write a custom load-balancing algorithm to optimize serving efficiency
• Build quantitative models of system performance
• Design and implement a fault-tolerant distributed system running with a complex network topology
• Debug kernel-level network latency spikes in a containerized environment

Benefits

• Comprehensive health, dental, and vision insurance for you and your dependents
• Inclusive fertility benefits via Carrot Fertility
• 22 weeks of paid parental leave
• Flexible paid time off and absence policies
• Mental health support for you and your dependents
• Competitive salary and equity packages
• Optional equity donation matching at a 1:1 ratio, up to 25% of your equity grant
• Retirement plans with competitive matching
• Life and income protection plans
• $500/month flexible wellness and time saver stipend
• Commuter benefits
• Annual education stipend
• Home office stipends
• Relocation support for those moving for Anthropic
• Daily meals and snacks in the office

Want to learn more about machine learning researchHave significant software engineering or machine learning experience, particularly at supercomputing scaleCare about the societal impacts of your workAre results-oriented, with a bias towards flexibility and impactPick up slack, even if it goes outside your job descriptionEnjoy pair programming (we love to pair!)High performance, large-scale ML systemsGPU/Accelerator programmingOS internalsML framework internalsLanguage modeling with transformersStrong candidates here will have a track record of solving large-scale systems problems and will be excited to grow to become an expert in ML also