Senior AI Inference Systems Engineer

Alex Loftus; Northern, New York (KY, NY); Hybrid; USD 320,000 - 485,000; Full time

Benefits offered by this job

Equity donation matching

Vacation and parental leave

Flexible working hours

Office space

Job summary

Anthropic is hiring for an inference systems role focused on building and operating distributed infrastructure that powers Claude across global users. You will design resilient systems, optimize routing and autoscaling, and enable researchers with high-performance inference capabilities.

The role emphasizes collaboration across production and research teams and involves multi-cloud deployments and cutting-edge model deployment pipelines.

Qualifications

• Bachelor’s degree or equivalent education and experience.
• Hands-on experience with distributed systems and inference infrastructure.
• Proficiency in Python or Rust and modern cloud tooling.

Responsibilities

• Design, build, and maintain distributed systems serving Claude to millions of users.
• Develop resilient, scalable systems that adapt in real time to events.
• Implement intelligent request routing and traffic management across accelerators and clouds.
• Maximize compute efficiency via autoscaling across production, research, and experiments.
• Build deployment pipelines for releasing new models to users.
• Provide high-performance inference infrastructure for researchers.

Skills

Distributed systems

Load balancing

Python

Rust

Kubernetes

Cloud infrastructure

Education

Bachelor's degree

Tools

AWS

GCP

Azure

Job description

Anthropic is hiring for an inference systems role focused on building and operating distributed infrastructure that powers Claude across global users. You will design resilient systems, optimize routing and autoscaling, and enable researchers with high-performance inference capabilities.

The role emphasizes collaboration across production and research teams and involves multi-cloud deployments and cutting-edge model deployment pipelines.