Staff Software Engineer, AI Safety & Safeguards

Anthropic Limited; San Francisco (CA); Hybrid; USD 320,000 - 485,000; Full time

Benefits offered by this job

Equity donation matching

Generous vacation & parental leave

Flexible working hours

Office space in San Francisco

Job summary

Anthropic is hiring software engineers to build safety and oversight mechanisms for AI systems. You will monitor models, prevent misuse, and ensure user well-being by developing distributed, scalable infrastructure across clouds.

This role emphasizes safety, transparency, and adherence to policies while deploying production systems. The team focuses on isolation, governance, and scalable monitoring, with collaboration across security, privacy, and legal to ship dependable detection capabilities

Qualifications

• Bachelor’s degree in Computer Science, Software Engineering or comparable experience.
• Proficiency in Python, Distributed Systems, and Infrastructure as Code.
• Experience with multiple cloud providers or provider-agnostic infrastructure.
• Built and operated large-scale distributed infrastructure such as data platforms, control planes, or job schedulers.
• Experience with sandboxing and isolation technologies (containers, microVMs) or with a systems language such as Rust.
• Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders.

Responsibilities

• Independently scope and lead complex, multi-month infrastructure projects, from an ambiguous starting point through to a production system.
• Develop monitoring systems to detect unwanted behaviors from API partners and surface these in internal dashboards to analysts for manual review.
• Stand up and run deployments of those monitoring systems across multiple clouds, including inside cloud-provider partner environments where data residency laws apply.
• Design and harden the sandboxed runtime that AI agents execute in: isolation, network egress controls, least-privilege data access, audit logging, and insider-risk controls.
• Manage cost and capacity for large volumes of long-running agent work, and set and meet service-level objectives for the platform.
• Partner with the engineers and researchers who write and evaluate the monitoring agents, and with security, privacy, and legal teams, so new detection work can ship quickly on a platform everyone trusts.

Skills

Python

Distributed Systems

Infrastructure as Code

Cloud providers

Data platforms

Control planes

Job schedulers

Containers

MicroVMs

Rust

Communication skills

Education

Bachelor's degree in Computer Science or Software Engineering

Job description

Anthropic is hiring software engineers to build safety and oversight mechanisms for AI systems. You will monitor models, prevent misuse, and ensure user well-being by developing distributed, scalable infrastructure across clouds.

This role emphasizes safety, transparency, and adherence to policies while deploying production systems. The team focuses on isolation, governance, and scalable monitoring, with collaboration across security, privacy, and legal to ship dependable detection capabilities