Senior Cloud Inference Engineer — Scale LLMs Across CSPs

Anthropic; San Francisco (CA); Hybrid; USD 300,000 - 485,000; Full time

Job summary

Anthropic is seeking a Cloud Infrastructure Engineer to design and build the necessary infrastructure for managing Claude across multiple cloud service providers while ensuring optimized performance and cost efficiency. This role requires significant experience in software engineering, distributed systems, and familiarity with major cloud platforms. The position offers an annual salary between $300,000 and $485,000, along with a hybrid work policy requiring in-office attendance 25% of the time.

Qualifications

• Strong background in high-performance, large-scale distributed systems serving millions of users.
• Experience building or operating services on a major cloud platform.
• Interest in inference.

Responsibilities

• Design and build infrastructure for Claude across multiple CSPs.
• Collaborate with CSP partner teams to resolve operational issues.
• Optimize inference cost and performance across providers.

Skills

Software engineering experience

Distributed systems

Kubernetes

Infrastructure as Code

Cost optimization

Python

Rust

Education

Bachelor's degree or equivalent

Job description

Anthropic is seeking a Cloud Infrastructure Engineer to design and build the necessary infrastructure for managing Claude across multiple cloud service providers while ensuring optimized performance and cost efficiency. This role requires significant experience in software engineering, distributed systems, and familiarity with major cloud platforms. The position offers an annual salary between $300,000 and $485,000, along with a hybrid work policy requiring in-office attendance 25% of the time.