Staff Senior Software Engineer, Inference Deployment

Anthropic; United States; Hybrid; USD 320,000 - 485,000; Full time

Benefits offered by this job

Equity donation matching

Generous vacation

Parental leave

Flexible working hours

Office in SF

Job summary

Anthropic is hiring a Staff + Senior Software Engineer for Inference Deployment to build and operate the systems that serve Claude to millions. You will design distributed services, optimize compute efficiency, and enable researchers with high-performance infrastructure across cloud platforms.

You will iterate on routing, autoscaling, and orchestration for production and research workloads, while collaborating with researchers and engineers to push safe, scalable AI.

Qualifications

• Experience designing distributed systems that scale to millions of users.
• Experience deploying machine learning inference systems at scale.
• Familiarity with load balancing, request routing, or traffic management.

Responsibilities

• Design, build, and maintain distributed inference systems for Claude across environments.
• Develop resilient, flexible systems that adapt in real time to events.
• Automate deployment pipelines for models to production and researchers.

Skills

Distributed systems

High-performance infra

Load balancing

Traffic routing

Research collaboration

Education

Bachelor's degree

Tools

Kubernetes

AWS

GCP

Azure

Python

Rust

Job description

Anthropic is hiring a Staff + Senior Software Engineer for Inference Deployment to build and operate the systems that serve Claude to millions. You will design distributed services, optimize compute efficiency, and enable researchers with high-performance infrastructure across cloud platforms.

You will iterate on routing, autoscaling, and orchestration for production and research workloads, while collaborating with researchers and engineers to push safe, scalable AI.