Senior Distributed Systems Engineer, Inference at Scale

Anthropic Limited; New York (NY); Hybride; USD 320 000 - 485 000; Plein temps

Résumé du poste

Anthropic Limited in the United States is seeking an experienced Distributed Systems Engineer for the Inference team, focusing on building and scaling Claude's inference infrastructure across multiple cloud providers.

You will design, implement, and operate high‑performance, production‑grade deployments, with emphasis on request routing, autoscaling, and cost optimization in a fast‑paced AI research environment.

Qualifications

• Significant software engineering experience with distributed systems.
• Results-oriented with bias toward flexibility and impact.
• Willingness to pick up slack beyond job description.
• Desire to learn more about machine learning systems and infrastructure.
• Thrive where technical excellence drives business results and research breakthroughs.
• Care about societal impacts of your work.

Responsabilités

• Design, build, and maintain the distributed systems that serve Claude to millions of users worldwide.
• Develop resilient, flexible systems that adapt in real time to events.
• Develop intelligent request routing, load balancing, and traffic management across accelerators and cloud providers.
• Maximize compute efficiency and optimize cost via autoscaling and orchestration across production and research workloads.
• Build and operate production-grade deployment pipelines for releasing new models.
• Provide high-performance inference infrastructure for researchers developing next‑generation models.
• Integrate new AI accelerator platforms and support inference for new model architectures.

Connaissances

Distributed systems

Results oriented

Adaptability

Learning mindset

Societal impact

Team collaboration

Formation

Bachelor’s degree or equivalent

Field relevant to the role

Outils

Kubernetes

Cloud platforms (AWS/GCP/Azure)

Python

Rust

Description du poste

Anthropic Limited in the United States is seeking an experienced Distributed Systems Engineer for the Inference team, focusing on building and scaling Claude's inference infrastructure across multiple cloud providers.

You will design, implement, and operate high‑performance, production‑grade deployments, with emphasis on request routing, autoscaling, and cost optimization in a fast‑paced AI research environment.