Cyber Harm Safeguards Analyst — Remote

Appliedmethods; San Francisco (CA); Hybrid; USD 285,000 - 330,000; Full time

Job summary

Anthropic is seeking a Safeguards Enforcement Analyst to review flagged content and enforcement actions across products, focusing on cyber threat mitigation and misuse of AI systems. You will work with cross-functional teams to surface model errors and policy gaps while maintaining high accuracy in enforcement decisions.

The role involves remote-friendly work, exposure to sensitive content, and collaboration with policy, engineering, and legal teams to uphold safe AI usage at scale.

Qualifications

• Experience in cybersecurity, including offensive techniques, malware analysis, or vulnerability research.
• Experience performing content review, abuse investigations, or policy enforcement at scale.
• Proficiency in SQL and/or Python for data analysis and threat detection.
• Experience with generative AI products and crafting effective prompts for review.

Responsibilities

• Review flagged content and accounts to make accurate enforcement decisions.
• Detect and mitigate misuse of AI systems for cyber operations.
• Triage and escalate high-severity cases to stakeholders.
• Provide feedback to policy design teams on gaps surfaced by enforcement.
• Collaborate with Engineering and Data Science to surface detection issues and improve models.

Skills

Cybersecurity experience

Content review & enforcement

SQL

Python

Policy feedback & collaboration

Generative AI familiarity

Education

Bachelor's degree in a relevant field

Tools

SQL

Python

Job description

Anthropic is seeking a Safeguards Enforcement Analyst to review flagged content and enforcement actions across products, focusing on cyber threat mitigation and misuse of AI systems. You will work with cross-functional teams to surface model errors and policy gaps while maintaining high accuracy in enforcement decisions.

The role involves remote-friendly work, exposure to sensitive content, and collaboration with policy, engineering, and legal teams to uphold safe AI usage at scale.