Staff Software Engineer, Inference Infrastructure (Hybrid)

FDE Times

San Francisco, New York, Seattle (CA, NY, WA)

Hybrid

USD 320,000 - 485,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive compensation & benefits
Equity donation matching (optional)
Generous vacation and parental leave
Flexible working hours
Office space in San Francisco

Job summary

Anthropic is hiring for a role on the Inference team that builds and maintains the high-performance systems powering Claude for millions of users. You will design scalable, resilient infrastructure and intelligent routing across diverse accelerators to support both production and research workloads.

The team prioritizes compute efficiency and research enablement, with deployments across cloud platforms and multiple accelerators.

Qualifications

  • Significant software engineering experience in distributed systems.
  • Experience with large-scale infrastructure and performance optimization.
  • Willingness to learn and adapt in a fast-moving environment.
  • Interest in machine learning systems and infrastructure.
  • Ability to work across teams to drive impact and research outcomes.

Responsibilities

  • Design, build, and maintain distributed systems serving Claude to millions of users.
  • Develop resilient, flexible systems that adapt in real time to events.
  • Develop intelligent request routing, load balancing, and traffic management across accelerators.
  • Maximize compute efficiency via autoscaling and orchestration for production and research workloads.
  • Build and operate deployment pipelines for models release to users.
  • Provide high-performance inference infrastructure for researchers.
  • Integrate new AI accelerator platforms for inference.

Skills

Distributed systems
Python or Rust
Kubernetes
Cloud infrastructure
Load balancing & routing
Research collaboration

Education

Bachelor’s degree

Tools

AWS
GCP
Azure

Job description

Anthropic is hiring for a role on the Inference team that builds and maintains the high-performance systems powering Claude for millions of users. You will design scalable, resilient infrastructure and intelligent routing across diverse accelerators to support both production and research workloads.

The team prioritizes compute efficiency and research enablement, with deployments across cloud platforms and multiple accelerators.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Software Engineer, Scalable Inference Infrastructure
Staff Software Engineer, Scalable Inference Infrastructure

Anthropic Limited • Seattle (WA)

Hybrid
USD 320,000 - 485,000
Competitive compensation and benefits
Equity donation matching (optional)
Generous vacation and parental leave
+2
Senior Systems Engineer - Scalable AI Inference
Senior Systems Engineer - Scalable AI Inference

FDE Times • San Francisco (CA)

Hybrid
CAD 140,000 - 200,000
Competitive compensation
Hybrid work model
Generous vacation policy
Senior/Staff Software Engineer — Scalable AI Inference Systems
Senior/Staff Software Engineer — Scalable AI Inference Systems

EngineersOfAI • New York (NY)

On-site
USD 180,000 - 280,000
Staff Software Engineer - Scalable Inference Systems
Staff Software Engineer - Scalable Inference Systems

Anthropic Limited • Seattle (WA)

Hybrid
USD 320,000 - 485,000
Senior Distributed Systems Engineer, Inference at Scale
Senior Distributed Systems Engineer, Inference at Scale

Anthropic Limited • New York (NY)

Hybrid
USD 320,000 - 485,000
Staff AI Inference Systems Engineer
Staff AI Inference Systems Engineer

Anthropic Limited • San Francisco (CA)

On-site
USD 320,000 - 485,000
Equity donation matching
Generous vacation
Parental leave
+2
Staff + Sr. Software Engineer, Scaling
Staff + Sr. Software Engineer, Scaling

EngineersOfAI • New York (NY)

On-site
USD 180,000 - 280,000
Performance Engineer, Inference Systems
Performance Engineer, Inference Systems

Anthropic Limited • Seattle (WA)

Hybrid
USD 350,000 - 850,000
Staff Cloud Inference Engineer (Multi-Cloud)
Staff Cloud Inference Engineer (Multi-Cloud)

Anthropic Limited • Seattle (WA)

Hybrid
USD 320,000 - 485,000
Staff + Sr. Software Engineer, Cloud Inference
Staff + Sr. Software Engineer, Cloud Inference

EngineersOfAI • San Francisco (CA)

Hybrid
USD 180,000 - 260,000