Cloud Inference Launch Engineer — Staff/Senior

3M HEALTHCARE; Seattle, San Francisco (WA, CA); Hybrid; USD 320,000 - 485,000; Full time

Job summary

Anthropic is seeking an experienced engineer to scale and optimize Claude on major cloud platforms. You’ll own validation, inference launches, and platform integration across AWS, GCP, and Azure.

You’ll build fast, reliable CI/CD for the inference server and load balancer, address cross-cloud gaps, and drive efficiency in production workloads. The role emphasizes high-performance distributed systems, cross-functional collaboration, and autonomy in delivering production-ready features with strong

Qualifications

• Bachelor's degree in a related field or equivalent experience.
• Strong software engineering experience with large-scale distributed systems.
• Experience building or operating services on at least one major cloud platform (AWS, GCP, or Azure).

Responsibilities

• Be on the critical path for frontier model launches, bringing up inference for new model architectures and shipping them to cloud platforms in lockstep with our first-party platform.
• Work with the core inference team to bring new inference features to cloud platforms, owning the platform-specific integration that gets them to production.
• Identify and fix gaps that cause inference differences across first-party and CSPs (config drift, observability, deployment patterns, cross-platform bugs).
• Design, build, and own the CI/CD infrastructure for the inference server and load balancer across cloud platforms, with shadow traffic and performance baselines.
• Drive down merge-to-production cycle time by making validation faster, more parallel, and cost-effective while preserving reliability.
• Analyze observability data to identify performance bottlenecks and regressions, driving remediation based on production workloads.

Skills

Distributed systems

Cloud platforms (AWS/GCP/Azure)

Kubernetes

Python or Rust

CI/CD automation

Education

Bachelor’s degree or equivalent

Tools

Terraform

CI/CD tooling

Job description

Anthropic is seeking an experienced engineer to scale and optimize Claude on major cloud platforms. You’ll own validation, inference launches, and platform integration across AWS, GCP, and Azure.

You’ll build fast, reliable CI/CD for the inference server and load balancer, address cross-cloud gaps, and drive efficiency in production workloads. The role emphasizes high-performance distributed systems, cross-functional collaboration, and autonomy in delivering production-ready features with strong