Remote AI Trust & Safety Enforcement Analyst

Appliedmethods; San Francisco (CA); Hybrid; USD 285,000 - 330,000; Full time

Benefits offered by this job

Flexible working hours

Office space

Equity donation matching

Vacation and parental leave

Job summary

Anthropic is seeking a Safeguards Analyst in the Integrity & Authenticity space to design scalable enforcement workflows and partner with engineering and data science to improve detection models. You will review content, shape policy enforcement, and tackle AI-enabled influence operations with a strong emphasis on privacy, elections, and surveillance ethics.

The role requires cross-functional collaboration with product, policy, engineering, and legal teams, and may involve weekend/holiday

Qualifications

• Experience in trust & safety, policy enforcement, threat intelligence, or related field.
• Experience standing up and scaling policy enforcement or content review workflows.
• Proficiency in SQL and/or other data analysis tools for large datasets.
• Experience identifying emerging risks and communicating findings to diverse stakeholders.
• Experience with generative AI products and writing prompts for content review/enforcement.
• Understanding challenges implementing product policies at scale in moderation.

Responsibilities

• Design and architect automated enforcement systems and scalable review workflows.
• Partner with Engineering and Data Science to optimize detection models for policy violations.
• Review flagged content to drive enforcement and policy improvements.
• Enforce usage policies focusing on AI-enabled influence operations and inauthentic behavior.
• Provide policy-design feedback based on enforcement scenarios.
• Stay current with best practices and regulatory developments in elections, privacy, and surveillance.

Skills

SQL

Policy enforcement

Threat intelligence

Python

Data analysis

Content review

Education

Bachelor’s degree

Tools

OSINT tools

Data analysis tools

Job description

Anthropic is seeking a Safeguards Analyst in the Integrity & Authenticity space to design scalable enforcement workflows and partner with engineering and data science to improve detection models. You will review content, shape policy enforcement, and tackle AI-enabled influence operations with a strong emphasis on privacy, elections, and surveillance ethics.

The role requires cross-functional collaboration with product, policy, engineering, and legal teams, and may involve weekend/holiday