AI Safeguards Enforcement Architect

Anthropic; New York (NY); Hybrid; USD 285,000 - 330,000; Full time

Job summary

Anthropic is seeking a Safeguards Analyst focused on Integrity & Authenticity to build enforcement workflows for preventing misuse of AI systems in coordinated inauthentic behavior, election manipulation, and targeting individuals.

You will work across harm areas including AI-enabled influence operations and privacy-related surveillance, shaping policy enforcement for safe user interaction with our products.

Qualifications

• Experience in trust & safety, policy enforcement, or threat intelligence with focus on influence operations, disinformation, or privacy harms.
• Experience standing up and scaling policy enforcement or content review workflows.
• Proficiency in SQL and/or other data analysis tools to draw insights from large datasets.
• Experience identifying emerging risks and communicating findings to cross-functional teams including Product, Policy, Engineering, and Legal.
• Experience working with generative AI products, including writing effective prompts for content review and enforcement.
• Understanding of the challenges involved in implementing product policies at scale, including in the content moderation space.

Responsibilities

• Design and architect automated enforcement systems and review workflows that scale effectively while maintaining high accuracy.
• Partner with Engineering and Data Science teams to optimize detection models for policy violations and automated enforcement systems.
• Review flagged content to drive enforcement and policy improvements.
• Enforce usage policies with a focus on detecting and mitigating AI-enabled influence operations, coordinated inauthentic behavior, election interference, and targeting, tracking, or surveillance of individuals and groups.
• Support the Safeguards policy design team by providing detailed feedback on policy gaps based on real enforcement scenarios.
• Keep up to date with emerging AI policy enforcement best practices, evolving threat actor tactics, and the regulatory landscape around elections, privacy, and surveillance, using these to inform our decision-making and workflows.

Skills

Trust & safety

Policy enforcement

Threat intelligence

Data analysis

Generative AI

AI policy at scale

Education

Bachelor’s degree or equivalent

Tools

Python

Job description

Anthropic is seeking a Safeguards Analyst focused on Integrity & Authenticity to build enforcement workflows for preventing misuse of AI systems in coordinated inauthentic behavior, election manipulation, and targeting individuals.

You will work across harm areas including AI-enabled influence operations and privacy-related surveillance, shaping policy enforcement for safe user interaction with our products.