Senior Inference Deployment Engineer — Distributed Systems

Anthropic Limited; Seattle (WA); Hybrid; USD 320,000 - 485,000; Full time

Benefits offered by this job

Competitive compensation

Equity matching (optional)

Generous vacation

Parental leave

Flexible working hours

Office space

Job summary

Anthropic is seeking a Senior Software Engineer for the Inference team to design, build, and operate distributed inference systems powering Claude for millions of users worldwide. You will optimize compute, ensure reliability, and enable researchers to push models in production with scalable routing and orchestration across multiple accelerators.

You should have strong background in distributed systems, experience with Kubernetes and cloud platforms, and proficiency in Python or Rust; we value

Qualifications

• Significant software engineering experience, especially with distributed systems.
• Results-oriented, with a bias towards flexibility and impact.
• Willingness to pick up slack, even if it goes outside your job description.
• Desire to learn more about machine learning systems and infrastructure.
• Thrive in environments where technical excellence directly drives both business results and research breakthroughs.
• Care about the societal impacts of your work.

Responsibilities

• Design, build, and maintain the distributed systems that serve Claude to millions of users worldwide.
• Develop resilient, flexible systems that adapt in real time to real world events.
• Develop intelligent request routing, load balancing, and traffic management systems across thousands of accelerators.
• Maximize compute efficiency across the fleet by autoscaling and orchestrating production, research, and experimental workloads.
• Build and operate production-grade deployment pipelines for releasing new models to users.
• Provide high-performance inference infrastructure that enables researchers to develop next-generation models.

Skills

Distributed systems

Performance optimization

Research collaboration

Flexibility & impact

Machine learning infra

Societal impact awareness

Education

Bachelor's degree or equivalent

Tools

Kubernetes

AWS

GCP

Azure

Python

Rust

Job description

Anthropic is seeking a Senior Software Engineer for the Inference team to design, build, and operate distributed inference systems powering Claude for millions of users worldwide. You will optimize compute, ensure reliability, and enable researchers to push models in production with scalable routing and orchestration across multiple accelerators.

You should have strong background in distributed systems, experience with Kubernetes and cloud platforms, and proficiency in Python or Rust; we value