AI Safeguards & Integrity Analyst

Anthropic Limited; Maryland; Hybrid; USD 285,000 - 330,000; Full time

Job summary

Anthropic is seeking a Safeguards Analyst focusing on Integrity & Authenticity to build and run enforcement workflows for our AI products. You will detect and mitigate misuse, including coordinated inauthentic behavior and election-related surveillance, with exposure to sensitive content.

The role may involve weekend/holiday escalations around major events. We value experience in trust & safety, policy enforcement, and data analysis, plus SQL and Python skills, to scale our policies across

Qualifications

• Experience in trust & safety, policy enforcement, threat intelligence, or related field with focus on influence operations, disinformation, coordinated inauthentic behavior, election integrity, or privacy harms.
• Experience standing up and scaling policy enforcement or content review workflows.
• Proficiency in SQL or other data analysis tools to draw insights from large datasets.
• Ability to identify emerging risks and communicate findings to diverse stakeholders (Product, Policy, Engineering, Legal).
• Experience with generative AI products, including writing effective prompts for content review and enforcement.
• Understanding challenges of implementing product policies at scale, including content moderation.

Responsibilities

• Design and architect automated enforcement systems and review workflows that scale effectively while maintaining high accuracy
• Partner with Engineering and Data Science teams to optimize detection models for policy violations and automated enforcement systems
• Review flagged content to drive enforcement and policy improvements
• Enforce usage policies with a focus on detecting and mitigating AI-enabled influence operations, coordinated inauthentic behavior, election interference, and targeting, tracking, or surveillance of individuals and groups
• Support the Safeguards policy design team by providing detailed feedback on policy gaps based on real enforcement scenarios
• Keep up to date with emerging AI policy enforcement best practices, evolving threat actor tactics, and the regulatory landscape around elections, privacy, and surveillance, using these to inform our decision-making and workflows

Skills

Trust & Safety

Policy Enforcement

Threat Intelligence

Data Analysis

SQL

Cross-functional Collaboration

Generative AI

Policy at Scale

Communication Skills

Education

Bachelor's degree

Tools

Python

Job description

Anthropic is seeking a Safeguards Analyst focusing on Integrity & Authenticity to build and run enforcement workflows for our AI products. You will detect and mitigate misuse, including coordinated inauthentic behavior and election-related surveillance, with exposure to sensitive content.

The role may involve weekend/holiday escalations around major events. We value experience in trust & safety, policy enforcement, and data analysis, plus SQL and Python skills, to scale our policies across