Staff Software Engineer, Scalable Inference Infrastructure

Anthropic Limited; Seattle (WA); Hybrid; USD 320,000 - 485,000; Full time

Benefits offered by this job

Competitive compensation and benefits

Equity donation matching (optional)

Generous vacation and parental leave

Flexible working hours

Office space

Job summary

Anthropic is seeking a Senior Engineer to design, build, and operate large-scale inference systems powering Claude for millions of users. You will optimize compute efficiency, implement intelligent routing and autoscaling, and shepherd production deployment pipelines for new models across multiple accelerators and cloud platforms.

The role emphasizes performance, reliability, and collaboration with researchers and engineers to advance next-generation AI infrastructure, with a location-based

Qualifications

• Bachelor's degree or equivalent combination of education, training, and/or experience.
• Strong experience with distributed systems and software engineering.
• Interest in machine learning systems and infrastructure.

Responsibilities

• Design, build, and maintain the distributed systems that serve Claude to millions of users worldwide
• Develop resilient, flexible systems that adapt in real time to real world events
• Develop intelligent request routing, load balancing, and traffic management systems across accelerators
• Maximize compute efficiency across the fleet by autoscaling and orchestrating workloads
• Build and operate production-grade deployment pipelines for releasing new models to users
• Provide high-performance inference infrastructure for researchers to develop next-generation models

Skills

Distributed systems

High-performance

Load balancing

Traffic management

Kubernetes

Cloud infrastructure

Python

Rust

Education

Bachelor's degree

Tools

Kubernetes

AWS

GCP

Azure

Job description

Anthropic is seeking a Senior Engineer to design, build, and operate large-scale inference systems powering Claude for millions of users. You will optimize compute efficiency, implement intelligent routing and autoscaling, and shepherd production deployment pipelines for new models across multiple accelerators and cloud platforms.

The role emphasizes performance, reliability, and collaboration with researchers and engineers to advance next-generation AI infrastructure, with a location-based