AI Safeguards Enforcement Analyst

Anthropic; New York (NY); Ibrido; USD 285.000 - 330.000; Tempo pieno

Descrizione del lavoro

Anthropic is seeking an Enforcement Analyst in New York to review content and enforce policies across our products, focusing on preventing misuse of AI in cyber operations. The role emphasizes safety, accuracy, and collaboration with cross-functional teams.

You will work with Safety, Policy, Engineering, and Data Science to surface detection gaps, handle complex cases, and improve enforcement tooling. Expect some weekend escalations as needed.

Competenze

• Experience in cybersecurity, including malware analysis or exploit development.
• Experience performing content reviews or policy enforcement at scale.
• Proficient in SQL and/or Python for data analysis and threat detection.
• Experience with generative AI products and prompt design.

Mansioni

• Review flagged content and enforce decisions per usage policies.
• Detect and mitigate misuse of AI for cyber operations.
• Triage high-severity cases and escalate appropriately.
• Provide feedback to Safeguards policy design team on gaps surfaced through enforcement scenarios.
• Collaborate with Engineering and Data Science to surface model errors and quality signals.
• Maintain high accuracy across review queues.
• Stay updated on threat landscape and enforcement best practices.

Conoscenze

Cybersecurity

SQL

Python

Policy enforcement

Content review

Generative AI

Threat detection

Formazione

Bachelor's degree

Descrizione del lavoro

Anthropic is seeking an Enforcement Analyst in New York to review content and enforce policies across our products, focusing on preventing misuse of AI in cyber operations. The role emphasizes safety, accuracy, and collaboration with cross-functional teams.

You will work with Safety, Policy, Engineering, and Data Science to surface detection gaps, handle complex cases, and improve enforcement tooling. Expect some weekend escalations as needed.