Violence & Extremism Safeguards Analyst

United States Digital Space LLC; United States; Hybrid; USD 285,000 - 330,000; Full time

Job summary

United States Digital Space LLC is seeking a Safeguards Enforcement Analyst focused on Violence & Extremism to build and run operational workflows that assess model behavior and drive enforcement decisions across challenging policy areas.

You will collaborate with Engineering and Data Science to detect misuse, develop evals, review content, and stay current with evolving threats and regulatory changes, ensuring robust enforcement and safe AI deployment.

Qualifications

• Experience in policy enforcement or threat intelligence with exposure to harmful content.
• Experience standing up scalable policy enforcement or content review workflows.
• Proficiency in SQL and/or other data analysis tools to draw insights from large datasets.
• Experience identifying emerging risks and communicating findings to multiple teams.
• Experience with generative AI products and writing prompts for content review.
• Understanding challenges of implementing product policies at scale in content moderation.

Responsibilities

• Design and architect automated enforcement systems and review workflows that scale while preserving accuracy.
• Develop evals to measure model performance across policy areas and surface regressions.
• Collaborate with Engineering and Data Science to optimize detection and enforcement systems for policy violations.
• Review flagged content to inform enforcement decisions and identify policy gaps.
• Support policy design with feedback from real enforcement scenarios.
• Maintain enforcement guidelines and reviewer documentation for consistency.
• Stay updated on threats and regulatory changes to inform workflows and evals.
• Identify emerging misuse patterns and novel attack vectors in extremist activity.

Skills

SQL

Python

Policy enforcement

Threat intelligence

Content review

Data analysis

Education

Bachelor’s degree

Tools

MITRE ATT&CK

OSINT techniques

Job description

United States Digital Space LLC is seeking a Safeguards Enforcement Analyst focused on Violence & Extremism to build and run operational workflows that assess model behavior and drive enforcement decisions across challenging policy areas.

You will collaborate with Engineering and Data Science to detect misuse, develop evals, review content, and stay current with evolving threats and regulatory changes, ensuring robust enforcement and safe AI deployment.