Lead, Safeguards & Content Review Ops

Socket.dev; New York (NY); Hybrid; USD 285,000 - 330,000; Full time

Job summary

Anthropic is seeking a Safeguards Enforcement Lead for the User Well-Being team. You will manage a team across policy areas, oversee content review workflows, and collaborate with Engineering and Legal to scale detection systems.

You will handle onboarding, QA, and escalation, while staying informed on evolving policy and legal frameworks. You will work with cross-functional partners to ensure accurate and consistent enforcement at scale, including reporting trends and coordinating external

Qualifications

• Experience managing teams in the User Well-Being space.
• Experience in trust & safety, content moderation operations, or policy enforcement with exposure to child safety, mental health, abuse and exploitation, and age assurance harm areas.
• Experience managing or coordinating content review operations, including quality assurance and workflow management.
• Experience standing up and scaling policy enforcement or content review workflows.
• Proficiency in SQL and/or other data analysis tools to monitor workflow health, review queue metrics, and surface enforcement trends.
• Experience identifying emerging risks and communicating findings to cross-functional stakeholders, such as Product, Policy, Engineering, and Legal teams.
• Understanding of challenges involved in implementing product policies at scale in the content moderation space.

Responsibilities

• Manage a team of individual contributors across multiple policy areas under the User Well-Being banner.
• Serve as the primary point of contact for review partners conducting content review, including onboarding, training, quality assurance, and ongoing relationship management.
• Design and improve enforcement workflows to scale effectively as volume grows, while maintaining high accuracy and consistency across review decisions.
• Partner with Engineering and Data Science teams to optimize detection models and automated enforcement systems for User Well-Being policies.
• Develop and maintain internal documentation, decision trees, and review guidelines that enable accurate and consistent enforcement at scale.
• Keep up to date with emerging AI policy enforcement best practices, evolving legal frameworks, and developments in technology, and use these to inform our workflows.
• Identify and report trends in misuse patterns to internal stakeholders, including Policy, Legal, and Trust & Safety leadership.
• Coordinate reporting obligations to relevant external bodies (e.g., NCMEC) in accordance with applicable law and Anthropic policy.

Skills

Team management

Policy enforcement

Content review operations

Workflow scaling

SQL & data analysis

Cross-functional communication

Product policy implementation

Education

Bachelor’s degree

Tools

Python

Hash-matching tech

Job description

Anthropic is seeking a Safeguards Enforcement Lead for the User Well-Being team. You will manage a team across policy areas, oversee content review workflows, and collaborate with Engineering and Legal to scale detection systems.

You will handle onboarding, QA, and escalation, while staying informed on evolving policy and legal frameworks. You will work with cross-functional partners to ensure accurate and consistent enforcement at scale, including reporting trends and coordinating external