Senior/Staff Inference Infrastructure Engineer

Menlo Ventures; San Francisco (CA); On-site; USD 150,000 - 210,000; Full time

Job summary

Anthropic is seeking a senior engineer to join the Inference team, building the systems that serve Claude to millions of users worldwide. You will work on distributed inference infrastructure, from request routing to orchestration across accelerators and clouds.

You will design resilient, high-performance components that adapt in real time to real-world events, enabling both reliable production workloads and ongoing research.

Qualifications

• Experience building large-scale distributed systems.
• Strong understanding of inference workloads and latency.
• Ability to design resilient, scalable software for production.

Responsibilities

• Design, build, and maintain distributed systems that serve Claude to millions of users worldwide.
• Develop resilient, flexible systems that adapt in real time to real world events.
• Develop intelligent request routing and fleet orchestration across accelerators and cloud platforms.

Skills

Distributed systems

Inference

Cloud deployment

Job description

Anthropic is seeking a senior engineer to join the Inference team, building the systems that serve Claude to millions of users worldwide. You will work on distributed inference infrastructure, from request routing to orchestration across accelerators and clouds.

You will design resilient, high-performance components that adapt in real time to real-world events, enabling both reliable production workloads and ongoing research.