Senior AI Inference Deployment Engineer

Anthropic; San Francisco (CA); On-site; USD 320,000 - 485,000; Full time

Benefits offered by this job

Competitive compensation

Flexible working hours

Generous vacation and parental leave

Equity donation matching

Job summary

Anthropic in San Francisco is seeking a Software Engineer for their Launch Engineering team. You'll design infrastructure to deploy AI models efficiently and manage resource constraints while ensuring high reliability. Ideal candidates should have robust software engineering skills and experience with Kubernetes.

This role offers a competitive salary range between $320,000 and $485,000 USD annually, reflecting the challenge and responsibility of the position. Anthropic values effective communication and collaboration in teams.

Qualifications

• Strong software engineering skills, including experience designing systems that manage complex state machines and multi-stage pipelines.
• Proficiency with Kubernetes-based deployments.
• Experience building infrastructure where resource constraints shape the design.
• A track record of improving deployment velocity and reliability.
• Strong communication skills and the ability to work closely with oncall engineers.

Responsibilities

• Own deployment orchestration that continuously moves validated inference builds into production.
• Improve capacity-aware deployment scheduling to maximize deployment throughput.
• Extend deployment observability with dashboards and tooling.
• Drive down cycle time from code merge to production.
• Optimize fleet rollout strategies across large-scale deployments.
• Evolve self-service model onboarding.
• Partner with teams to integrate deployment automation with their systems.

Skills

Software engineering skills

Kubernetes-based deployments

Experience with deployment infrastructure

Automation for deployment velocity

Comfort across the stack

Communication skills

Education

Bachelor's degree or equivalent

Tools

Kubernetes

Python

Rust

Job description

Anthropic in San Francisco is seeking a Software Engineer for their Launch Engineering team. You'll design infrastructure to deploy AI models efficiently and manage resource constraints while ensuring high reliability. Ideal candidates should have robust software engineering skills and experience with Kubernetes.

This role offers a competitive salary range between $320,000 and $485,000 USD annually, reflecting the challenge and responsibility of the position. Anthropic values effective communication and collaboration in teams.