Staff Engineer, Inference Tooling & DevX

anthropic; San Francisco, Seattle, New York (CA, WA, NY); Hybrid; USD 405,000 - 485,000; Full time

Job summary

Anthropic is seeking a Staff Software Engineer to own the technical roadmap for Inference Velocity, driving multi‑accelerator toolchains, CI/CD, and developer productivity across GPU, TPU, and Trainium platforms.

In this senior IC role, you will set architecture, partner with Infrastructure, mentor engineers, and ship reliable inference software at scale. This position offers a remote-friendly arrangement with some travel across major offices.

Qualifications

• 8+ years of software engineering experience.
• Technical lead or anchor on an infrastructure/platform/developer productivity team.
• Experience owning toolchains or development environments for compute-intensive workloads.

Responsibilities

• Set technical direction for Inference Developer Productivity across GPU, TPU, and Trainium toolchains and CI/CD.
• Own accelerator toolchain management: compilers, drivers, libraries, and frameworks.
• Design infrastructure for efficient accelerator usage and dev environments.
• Define and instrument productivity metrics and dashboards to surface regressions.
• Mentor engineers through design and code reviews, raising technical standards.

Skills

Software engineering

Technical lead

Infrastructure

Dev productivity

CI/CD

Education

Bachelor's degree

Tools

CUDA

TPU

Trainium

Kubernetes

Job description

Anthropic is seeking a Staff Software Engineer to own the technical roadmap for Inference Velocity, driving multi‑accelerator toolchains, CI/CD, and developer productivity across GPU, TPU, and Trainium platforms.

In this senior IC role, you will set architecture, partner with Infrastructure, mentor engineers, and ship reliable inference software at scale. This position offers a remote-friendly arrangement with some travel across major offices.