Staff+ Software Engineer (Infrastructure)

Anthropic; New York (NY); Hybrid; USD 180,000 - 280,000; Full time

Benefits offered by this job

Health insurance

Fertility benefits

Parental leave 22 weeks

Flexible PTO

Mental health support

Equity package

Relocation support

Home office stipend

Education stipend

Commuter benefits

Job summary

Anthropic is seeking experienced Infrastructure Engineers to join our team and help build, scale, and maintain cutting-edge AI systems. You will lead the build-out of AI clusters and partner with cloud providers to meet scalability needs, while collaborating with researchers and product teams to identify infrastructure solutions.

You will set strategy for high-scale, reliable infrastructure, mentor top engineers, and design robust incident response and postmortem processes to prevent repeat

Qualifications

• Bachelor's degree or equivalent in a related field.
• 10+ years of infra industry experience.
• 3+ years leading large-scale projects or teams.
• Deep Kubernetes, IaC, AWS, and GCP knowledge.
• Proficiency in Python, Rust, Go, or Java.
• Strong problem-solving and independence.
• Experience with ML infra such as GPUs/TPUs and networking.

Responsibilities

• Lead build-out of AI clusters and partner with cloud providers on scaling.
• Consult with stakeholders to identify infrastructure solutions.
• Set technical strategy and oversee high-scale, reliable systems.
• Mentor senior engineers and foster technical growth.
• Design postmortems, incident response, and on-call processes.

Skills

Kubernetes

Cloud infra

Python

Go

Rust

AWS

GCP

Linux kernel

eBPF

NCCL

ML infra

Communication

Leadership

Education

Bachelor's degree

Tools

Terraform

CI/CD

IaC

Job description

• Anthropic is seeking talented and experienced Infrastructure Engineers to join our team and support the development, scaling, and maintenance of our cutting-edge AI systems
• By joining our Infrastructure team, you will have the opportunity to work on groundbreaking AI technologies and contribute to the development of frontier models, supporting Anthropic's mission to create safe and reliable AI systems that benefit humanity
• Lead build out of industry-leading AI clusters (thousands to hundreds of thousands of machines), partnering closely with cloud service providers on cluster build out and required features
• Consult with different stakeholders to deeply understand infrastructure, data and compute needs, identifying potential solutions to support frontier research and product development
• Set technical strategy and oversee development of high scale, reliable infrastructure systems
• Mentor top technical talent
• Design processes (e.g. postmortem review, incident response, on-call rotations) that help the team operate effectively and never fail the same way twice

Benefits

• Comprehensive health, dental, and vision insurance for you and your dependents
• Inclusive fertility benefits via Carrot Fertility
• 22 weeks of paid parental leave
• Flexible paid time off and absence policies
• Mental health support for you and your dependents
• Competitive salary and equity packages
• Optional equity donation matching at a 1:1 ratio, up to 25% of your equity grant
• Retirement plans with competitive matching
• Life and income protection plans
• $500/month flexible wellness and time saver stipend
• Commuter benefits
• Annual education stipend
• Home office stipends
• Relocation support for those moving for Anthropic
• Daily meals and snacks in the office

• Are obsessed with distributed systems at scale, infrastructure reliability, scalability, security, and continuous improvement
• Have excellent communication skills to build consensus with stakeholders, both internally and externally
• Have 10+ years of relevant industry experience, 3+ years leading large scale, complex projects or teams as an engineer or tech lead
• Strong problem-solving skills and ability to work independently
• Possess deep knowledge of modern cloud infrastructure including Kubernetes, Infrastructure as Code, AWS, and GCP
• Strong proficiency in at least one programming language (e.g., Python, Rust, Go, Java)
• Have a passion for supporting internal partners like research to understand their needs
• Security and privacy best practice expertise
• Low level systems experience, for example linux kernel tuning and eBPF
• Experience with machine learning infrastructure like GPUs, TPUs, or Trainium, as well as supporting networking infrastructure like NCCL
• Technical expertise: Quickly understanding systems design tradeoffs, keeping track of rapidly evolving software systems

Location Policy

Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices

Education Requirements

Education requirements: We require at least a Bachelor's degree in a related field or equivalent experience