Staff+ Software Engineer - AI Safety & Safeguards

Anthropic Limited; San Francisco (CA); Hybrid; USD 320,000 - 485,000; Full time

Job summary

Anthropic Limited is seeking software engineers to help build safety and oversight mechanisms for our AI systems. As part of the Safeguards team, you will monitor models, prevent misuse, and enforce our terms and policies.

This role focuses on detecting unwanted behaviors and implementing defenses at scale, collaborating with researchers and stakeholders across the stack. Applicants should have a Bachelor's degree in Computer Science or equivalent, strong Python and TypeScript skills, and

Qualifications

• Bachelor’s degree in Computer Science, Software Engineering or comparable experience.
• Proficiency in Python and TypeScript.
• Ability to work across the stack.
• Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders.

Responsibilities

• Develop monitoring systems to detect unwanted behaviors from our API partners and alert analysts.
• Build abuse detection mechanisms and infrastructure.
• Surface abuse patterns to our research teams to harden models at the training stage.
• Build robust, multi-layered defenses for real-time improvements to safety mechanisms at scale.

Skills

Python

TypeScript

Cross-stack

Communication

Education

Bachelor’s degree in Computer Science or equivalent

Job description

Anthropic Limited is seeking software engineers to help build safety and oversight mechanisms for our AI systems. As part of the Safeguards team, you will monitor models, prevent misuse, and enforce our terms and policies.

This role focuses on detecting unwanted behaviors and implementing defenses at scale, collaborating with researchers and stakeholders across the stack. Applicants should have a Bachelor's degree in Computer Science or equivalent, strong Python and TypeScript skills, and