Senior Systems Engineer - Scalable AI Inference

FDE Times

San Francisco (CA)

Hybrid

CAD 140,000 - 200,000

Full time

8 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive compensation
Hybrid work model
Generous vacation policy

Job summary

Anthropic is seeking a seasoned software engineer to help build and maintain scalable inference systems that serve Claude to millions of users. You will work on the full stack from intelligent routing to fleet-wide orchestration, ensuring high performance and reliability across accelerators, cloud platforms, and research workloads.

The role emphasizes optimizing compute efficiency, developing robust deployment pipelines, and enabling researchers with cutting-edge infrastructure.

Qualifications

  • Significant software engineering experience with distributed systems.
  • Bias toward flexibility and impact in delivery.
  • Willingness to take on tasks beyond job description.
  • Desire to learn more about ML systems and infrastructure.
  • Thrive under environments where technical excellence drives business and research.
  • Care about societal impacts of work.

Responsibilities

  • Design, build, and maintain distributed systems serving Claude to millions of users.
  • Develop resilient, real-time adaptive systems.
  • Develop intelligent request routing, load balancing, and traffic management across accelerators.
  • Maximize compute efficiency via autoscaling and orchestration across workloads.
  • Build and operate production-grade deployment pipelines for new models.

Skills

Distributed systems
Software engineering
Performance optimization
Python
Rust
Kubernetes
Cloud platforms

Education

Bachelor’s degree

Tools

Kubernetes
AWS
GCP
Azure
Python
Rust

Job description

Anthropic is seeking a seasoned software engineer to help build and maintain scalable inference systems that serve Claude to millions of users. You will work on the full stack from intelligent routing to fleet-wide orchestration, ensuring high performance and reliability across accelerators, cloud platforms, and research workloads.

The role emphasizes optimizing compute efficiency, developing robust deployment pipelines, and enabling researchers with cutting-edge infrastructure.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior/Staff Software Engineer — Scalable AI Inference Systems
Senior/Staff Software Engineer — Scalable AI Inference Systems

EngineersOfAI • New York (NY)

On-site
USD 180,000 - 280,000
Staff Software Engineer, Scalable Inference Infrastructure
Staff Software Engineer, Scalable Inference Infrastructure

Anthropic Limited • Seattle (WA)

Hybrid
USD 320,000 - 485,000
Competitive compensation and benefits
Equity donation matching (optional)
Generous vacation and parental leave
+2
Senior Distributed Systems Engineer, Inference at Scale
Senior Distributed Systems Engineer, Inference at Scale

Anthropic Limited • New York (NY)

Hybrid
USD 320,000 - 485,000
Staff AI Inference Systems Engineer
Staff AI Inference Systems Engineer

Anthropic Limited • San Francisco (CA)

On-site
USD 320,000 - 485,000
Equity donation matching
Generous vacation
Parental leave
+2
Staff Software Engineer, Inference Infrastructure (Hybrid)
Staff Software Engineer, Inference Infrastructure (Hybrid)

FDE Times • San Francisco (CA), New York (NY), Seattle (WA)

Hybrid
USD 320,000 - 485,000
Competitive compensation & benefits
Equity donation matching (optional)
Generous vacation and parental leave
+2
Staff Software Engineer - Scalable Inference Systems
Staff Software Engineer - Scalable Inference Systems

Anthropic Limited • Seattle (WA)

Hybrid
USD 320,000 - 485,000
Staff + Sr. Software Engineer, Scaling
Staff + Sr. Software Engineer, Scaling

EngineersOfAI • New York (NY)

On-site
USD 180,000 - 280,000
Engineering Manager, Scalable Inference Platform
Engineering Manager, Scalable Inference Platform

Anthropic Limited • San Francisco (CA)

Hybrid
USD 405,000 - 625,000
Competitive compensation
Benefits
Equity donation matching
+4
Staff Software Engineer—Scalable AI Infra & Safe Execution
Staff Software Engineer—Scalable AI Infra & Safe Execution

Anthropic Limited • San Francisco (CA)

Hybrid
USD 320,000 - 485,000
Technical Program Manager - AI Inference & Fleet Scale
Technical Program Manager - AI Inference & Fleet Scale

EngineersOfAI • San Francisco (CA)

On-site
USD 180,000 - 260,000