AI Safeguards Enforcement Analyst

Society for AI Security; United States; Hybrid; USD 150,000 - 210,000; Full time

Job summary

Anthropic is seeking a Safeguards Enforcement Analyst focused on Integrity & Authenticity to build enforcement workflows for our products, detect and mitigate misuse of AI systems, including coordinated inauthentic behavior and election-related harms.

The role spans policy enforcement, incident response, and collaboration with Engineering, Policy, Legal, and Data Science teams to scale reviews, improve detection models, and stay current with evolving regulatory landscapes.

Qualifications

• Experience in trust & safety, policy enforcement, threat intelligence, or closely related field with a focus on influence operations, disinformation, coordinated inauthentic behavior, election integrity, or privacy and surveillance harms.
• Experience standing up and scaling policy enforcement or content review workflows.
• Proficiency in SQL and/or other data analysis tools to draw insights from large datasets.
• Experience working with generative AI products, including writing effective prompts for content review and enforcement.

Responsibilities

• Design and architect automated enforcement systems and review workflows that scale effectively while maintaining high accuracy.
• Partner with Engineering and Data Science teams to optimize detection models for policy violations and automated enforcement systems.
• Review flagged content to drive enforcement and policy improvements.
• Enforce usage policies with a focus on detecting and mitigating AI-enabled influence operations, coordinated inauthentic behavior, election interference, and targeting, tracking, or surveillance of individuals and groups.
• Support the Safeguards policy design team by providing detailed feedback on policy gaps based on real enforcement scenarios.

Skills

Policy enforcement

Threat intelligence

OSINT techniques

Cross-functional collaboration

Education

Bachelor's degree in related field

Tools

Python

SQL

Data analysis tools

Job description

Anthropic is seeking a Safeguards Enforcement Analyst focused on Integrity & Authenticity to build enforcement workflows for our products, detect and mitigate misuse of AI systems, including coordinated inauthentic behavior and election-related harms.

The role spans policy enforcement, incident response, and collaboration with Engineering, Policy, Legal, and Data Science teams to scale reviews, improve detection models, and stay current with evolving regulatory landscapes.