Senior Staff Software Engineer, AI Inference & Scale
Anthropic
A complete application in a minute
Tailored resume and cover letter, ready to send.
Benefits offered by this job
Job summary
Anthropic is seeking an experienced engineer to design, build, and operate the high-performance inference infrastructure that serves Claude globally. You will own distributed systems across multiple accelerators and cloud platforms, implementing intelligent routing, autoscaling, and resilient deployment pipelines.
The role focuses on maximizing compute efficiency, supporting both production and research workloads, and enabling researchers to push the boundaries of model architectures at scale in
Qualifications
- Significant software engineering experience with distributed systems.
- Proficiency in Python or Rust.
- Experience with load balancing and traffic management.
- Experience deploying ML systems at scale.
- Familiarity with Kubernetes and cloud infrastructure.
Responsibilities
- Design, build, and maintain the distributed systems that serve Claude to millions of users worldwide.
- Develop resilient, flexible systems that adapt in real time to real world events.
- Develop intelligent request routing, load balancing, and traffic management across accelerators and cloud providers.
- Maximize compute efficiency and optimize cost across the fleet by autoscaling and orchestration.
Skills
Tools
Job description
Anthropic is seeking an experienced engineer to design, build, and operate the high-performance inference infrastructure that serves Claude globally. You will own distributed systems across multiple accelerators and cloud platforms, implementing intelligent routing, autoscaling, and resilient deployment pipelines.
The role focuses on maximizing compute efficiency, supporting both production and research workloads, and enabling researchers to push the boundaries of model architectures at scale in
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
