Senior Cloud Inference Engineer: Scale & Optimize CSPs

Anthropic; Seattle (WA); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Comprehensive health, dental, and vis​

Job summary

Anthropic is seeking product-minded backend engineers to design, build, and own backend services for Claude across AWS, GCP, and Azure. You will navigate provider differences, optimize cost, and ensure reliability at massive scale while supporting multiple CSP platforms.

You will collaborate across inference, product API, systems, and security teams, implementing CI/CD pipelines and scalable deployment of new model versions to millions of users with robust safety and performance.

Qualifications

• Experience building or operating services on major cloud platforms (AWS, GCP, or Azure), with exposure to Kubernetes, Infrastructure as Code, or container orchestration.
• Significant software engineering experience with high-performance, large-scale distributed systems serving millions of users.
• Proficiency in Python or Rust and ability to ramp on new technologies and provider ecosystems.
• Ability to work autonomously end-to-end and collaborate across cross-functional teams.

Responsibilities

• Design, build, and own backend services and infrastructure that serve Claude across multiple CSPs, accounting for hardware, networking, APIs, and operational differences.
• Work cross-functionally with inference, product API, systems, and security teams, and with CSP partners to stand up the full serving stack on new cloud platforms.
• Build and evolve CI/CD automation systems and deployment pipelines to ship model versions to millions of users with zero regressions.
• Analyze observability data to identify performance bottlenecks and cost anomalies, driving remediation based on production workloads.

Skills

Python

Rust

Kubernetes

Infrastructure as Code

Multi-region deployments

Cost optimization

Cloud platforms experience

Tools

Kubernetes

Terraform

Job description

Anthropic is seeking product-minded backend engineers to design, build, and own backend services for Claude across AWS, GCP, and Azure. You will navigate provider differences, optimize cost, and ensure reliability at massive scale while supporting multiple CSP platforms.

You will collaborate across inference, product API, systems, and security teams, implementing CI/CD pipelines and scalable deployment of new model versions to millions of users with robust safety and performance.