AI Safeguards Enforcement Analyst

Anthropic; Friendly (MD); Hybrid; USD 285,000 - 330,000; Full time

Job summary

Anthropic is seeking an Enforcement Analyst to review content and enforce policies across products, with a focus on detecting misuse of AI in cyber operations. The role involves handling sensitive material and potential weekend/holiday escalations to uphold safe, honest user experiences.

Ideal candidates bring cybersecurity experience, content-review background, and proficiency in SQL or Python for threat detection.

Qualifications

• Minimum Qualifications section highlights cybersecurity experience, content review, and policy enforcement.
• Proficiency with SQL and/or Python for data analysis and threat detection.
• Experience reviewing content at scale and communicating findings to stakeholders.
• Familiarity with generative AI products and prompts for review.

Responsibilities

• Review flagged content and accounts to make enforcement decisions in line with policies.
• Detect and mitigate misuse of AI to facilitate cyberattacks, malware, or exploitation tooling.
• Triage high-severity cases and escalate when needed.
• Provide feedback to policy design teams based on enforcement scenarios.
• Collaborate with Engineering and Data Science to surface model errors and signals.

Skills

SQL

Python

Cybersecurity

Content review

Policy enforcement

Generative AI

Education

Bachelor's degree

Job description

Anthropic is seeking an Enforcement Analyst to review content and enforce policies across products, with a focus on detecting misuse of AI in cyber operations. The role involves handling sensitive material and potential weekend/holiday escalations to uphold safe, honest user experiences.

Ideal candidates bring cybersecurity experience, content-review background, and proficiency in SQL or Python for threat detection.