Staff Software Engineer, LLM Cloud Inference

Anthropic; San Francisco (CA); Hybrid; USD 320.000 - 485.000; Vollzeit

Zusammenfassung

Anthropic, a safety-focused AI company, is seeking backend engineers for the Cloud Inference team to scale Claude across AWS, GCP, Azure, and future CSPs. You will own services from API integration to inference execution and capacity management, working across platforms to keep reliability and cost-effectiveness at massive scale.

Ideal candidates have strong distributed systems experience, cloud exposure, and a taste for cross-functional collaboration with product, security, and partner teams.

Qualifikationen

• Significant software engineering experience with high-performance, large-scale distributed systems.
• Experience building or operating services on at least one major cloud platform (AWS, GCP, or Azure), with exposure to Kubernetes or IaC.
• Curious about LLM serving; prior ML experience not required.
• Thrive in cross-functional collaboration with internal teams and external partners.
• Experience working with external partners to align goals and deliver impact.
• Fast learner who can ramp up on new technologies and provider ecosystems.
• Highly autonomous and take ownership end-to-end.

Aufgaben

• Design, build, and own backend services and infrastructure across CSPs.
• Collaborate with inference, product API, systems, and security teams, plus CSP partners.
• Build and evolve CI/CD automation for model deployments across cloud platforms.
• Design interfaces and tooling to enable cost-effective inference management across providers.
• Contribute to capacity planning, autoscaling, and workload routing strategies.
• Analyze observability data to identify bottlenecks and drive remediation.

Kenntnisse

Distributed systems

Cloud platforms

Kubernetes

Infrastructure as Code

LLM serving

Cross-functional collaboration

Autonomy

Ausbildung

Bachelor’s degree

Tools

Python

Rust

Jobbeschreibung

Anthropic, a safety-focused AI company, is seeking backend engineers for the Cloud Inference team to scale Claude across AWS, GCP, Azure, and future CSPs. You will own services from API integration to inference execution and capacity management, working across platforms to keep reliability and cost-effectiveness at massive scale.

Ideal candidates have strong distributed systems experience, cloud exposure, and a taste for cross-functional collaboration with product, security, and partner teams.