AI Integrity & Safeguards Enforcement Analyst

Anthropic Limited; New York (NY); Hybrid; USD 285,000 - 330,000; Full time

Job summary

Anthropic is seeking a Safeguards Analyst to design enforcement systems and review workflows addressing integrity, authenticity, and AI-enabled misuse. You will work with policy, engineering, and data science teams to enhance detection models and ensure robust enforcement across products and services.

The role involves handling sensitive content, responding to escalations, and staying current with evolving laws and best practices in AI policy enforcement and elections privacy.

Qualifications

• Experience in trust & safety, policy enforcement, threat intelligence, or closely related fields with a focus on influence operations, disinformation, coordinated inauthentic behavior, election integrity, or privacy and surveillance harms.
• Experience standing up and scaling policy enforcement or content review workflows.
• Proficiency in SQL and/or other data analysis tools to draw insights from large datasets.

Responsibilities

• Design and architect automated enforcement systems and review workflows that scale effectively while maintaining high accuracy.
• Partner with Engineering and Data Science teams to optimize detection models for policy violations and automated enforcement systems.
• Review flagged content to drive enforcement and policy improvements.
• Enforce usage policies with a focus on detecting and mitigating AI-enabled influence operations, coordinated inauthentic behavior, election interference, and targeting, tracking, or surveillance of individuals and groups.
• Support the Safeguards policy design team by providing detailed feedback on policy gaps based on real enforcement scenarios.
• Keep up to date with emerging AI policy enforcement best practices, evolving threat actor tactics, and the regulatory landscape around elections, privacy, and surveillance, using these to inform our decision-making and workflows.

Skills

Trust & Safety

Policy Enforcement

Threat Intelligence

Influence Operations

Disinformation

Election Integrity

Privacy & Surveillance

Education

Bachelor's degree

Tools

SQL

Python

Job description

Anthropic is seeking a Safeguards Analyst to design enforcement systems and review workflows addressing integrity, authenticity, and AI-enabled misuse. You will work with policy, engineering, and data science teams to enhance detection models and ensure robust enforcement across products and services.

The role involves handling sensitive content, responding to escalations, and staying current with evolving laws and best practices in AI policy enforcement and elections privacy.