Senior Staff Engineer, AI Inference Systems

Anthropic; New York (NY); Hybrid; USD 320,000 - 485,000; Full time

Job summary

Anthropic is hiring a Staff + Senior Software Engineer, specializing in Inference, to design and build distributed systems for its AI platform, Claude. This position emphasizes maximizing compute efficiency and requires collaboration with a dynamic team to contribute to next-generation AI systems.

The ideal candidate will have experience with machine learning infrastructure, distributed systems, and optimizing performance in a high-scale environment. The role requires a Bachelor’s degree and offers a competitive salary range of $320,000 to $485,000 per year.

Qualifications

• Experience with high-performance, large-scale distributed systems.
• Experience implementing and deploying machine learning systems at scale.
• Experience with load balancing, request routing, or traffic management systems.

Responsibilities

• Design, build, and maintain distributed systems serving Claude worldwide.
• Develop intelligent request routing, load balancing, and traffic management.
• Maximize compute efficiency through autoscaling and orchestration.

Skills

Distributed systems expertise

High-performance computing

Machine learning systems

Python or Rust

Kubernetes

Cloud infrastructure (AWS, GCP, Azure)

Education

Bachelor’s degree or equivalent

Job description

Anthropic is hiring a Staff + Senior Software Engineer, specializing in Inference, to design and build distributed systems for its AI platform, Claude. This position emphasizes maximizing compute efficiency and requires collaboration with a dynamic team to contribute to next-generation AI systems.

The ideal candidate will have experience with machine learning infrastructure, distributed systems, and optimizing performance in a high-scale environment. The role requires a Bachelor’s degree and offers a competitive salary range of $320,000 to $485,000 per year.