Staff & Senior Software Engineer – Scalable AI Inference

Anthropic; San Francisco (CA); On-site; USD 320,000 - 485,000; Full time

Benefits offered by this job

Competitive pay

Equity matching

Generous vacation

Parental leave

Flexible hours

Office in SF

Job summary

Anthropic is seeking an experienced software engineer to drive the design and scaling of Claude's inference systems. You will own distributed, high-performance architectures across cloud providers to support millions of users.

The role emphasizes intelligent routing, autoscaling, and production pipelines, enabling researchers to push next-generation models while controlling costs. Office-based hybrid work is expected in SF.

Qualifications

• Significant software engineering experience, particularly with distributed systems.
• Results-oriented with a bias toward flexibility and impact.
• Willingness to pick up slack beyond the job description.
• Desire to learn more about machine learning systems and infrastructure.
• Thrive in environments where technical excellence directly drives business results and research breakthroughs.

Responsibilities

• Design, build, and maintain the distributed systems that serve Claude to millions of users worldwide.
• Develop resilient, flexible systems that adapt in real time to real world events.
• Develop intelligent request routing, load balancing, and traffic management across thousands of accelerators and multiple cloud providers.
• Maximize compute efficiency and optimize cost across the fleet by autoscaling and orchestrating production, research, and experimental workloads.
• Build and operate production-grade deployment pipelines for releasing new models to users.
• Provide high-performance inference infrastructure that enables researchers to develop next-generation models.
• Integrate new AI accelerator platforms and support inference for new model architectures.

Skills

Distributed systems

Python

Rust

Kubernetes

Cloud platforms

Load balancing

Inference optimization

High-performance

Networking

Linux

Education

Bachelor's degree or equivalent

Tools

AWS

GCP

Azure

Linux

Job description

Anthropic is seeking an experienced software engineer to drive the design and scaling of Claude's inference systems. You will own distributed, high-performance architectures across cloud providers to support millions of users.

The role emphasizes intelligent routing, autoscaling, and production pipelines, enabling researchers to push next-generation models while controlling costs. Office-based hybrid work is expected in SF.