Senior Staff Software Engineer — AI Inference Systems

Anthropic; New York (NY); Hybrid; USD 320,000 - 485,000; Full time

Job summary

Anthropic is looking for an experienced engineer to join the Inference Team in New York. The role involves designing and maintaining systems that serve Claude to millions of users worldwide, emphasizing distributed systems and machine learning infrastructure.

Candidates should have a Bachelor's degree and significant software engineering experience, particularly with distributed systems. The position offers a hybrid work model allowing flexibility while ensuring collaboration and productivity.

Qualifications

• Significant software engineering experience, especially with distributed systems.
• Enjoy pair programming and learning about machine learning systems.
• Thrives in technical excellence-driven environments.

Responsibilities

• Design, build, and maintain distributed systems that serve Claude.
• Develop intelligent request routing and load balancing systems.
• Maximize compute efficiency across the fleet.

Skills

Software engineering

Distributed systems

Machine learning

Kubernetes

Python

Rust

Education

Bachelor’s degree or equivalent

Tools

AWS

GCP

Azure

Job description

Anthropic is looking for an experienced engineer to join the Inference Team in New York. The role involves designing and maintaining systems that serve Claude to millions of users worldwide, emphasizing distributed systems and machine learning infrastructure.

Candidates should have a Bachelor's degree and significant software engineering experience, particularly with distributed systems. The position offers a hybrid work model allowing flexibility while ensuring collaboration and productivity.