Senior/Staff AI Inference Deployment Engineer

Anthropic Limited; New York (NY); Hybrid; USD 320,000 - 485,000; Full time

Benefits offered by this job

Competitive compensation

Equity donation matching

Generous vacation and parental leave

Flexible working hours

Job summary

Anthropic Limited in the United States currently seeks a senior role to design and operate large-scale inference infrastructure for Claude. You will optimize distributed systems across multi-region deployments, focusing on real-time routing, autoscaling, and high-performance compute for research and production workloads.

Based in New York with a location-based hybrid policy, you will collaborate with researchers and engineers to advance steerable AI while delivering reliable, scalable services

Qualifications

• Strong experience building distributed systems.
• Interest in machine learning infrastructure is a plus.
• Ability to scale systems to millions of users.

Responsibilities

• Design, build, and maintain the distributed systems that serve Claude to millions of users worldwide
• Develop resilient, flexible systems that adapt in real time to real world events
• Develop intelligent request routing, load balancing, and traffic management systems across thousands of accelerators
• Maximize compute efficiency across the fleet by autoscaling and orchestrating production, research, and experimental workloads
• Build and operate production-grade deployment pipelines for releasing new models to users
• Provide high-performance inference infrastructure that enables researchers to develop next-generation models
• Integrate new AI accelerator platforms and support inference for new model architectures

Skills

Distributed systems

Python

Rust

Kubernetes

Cloud infra (AWS/GCP/Azure)

Education

Bachelor's degree

Tools

Docker

Git

Job description

Anthropic Limited in the United States currently seeks a senior role to design and operate large-scale inference infrastructure for Claude. You will optimize distributed systems across multi-region deployments, focusing on real-time routing, autoscaling, and high-performance compute for research and production workloads.

Based in New York with a location-based hybrid policy, you will collaborate with researchers and engineers to advance steerable AI while delivering reliable, scalable services