AI Violence & Fiction Policy Evaluator

Handshake; Seattle (WA); On-site; USD 76,000 - 124,000; Full time

Benefits offered by this job

Benefits eligible

Job summary

Handshake is seeking an AI Policy Specialist to evaluate violence-related requests and model outputs. You will distinguish fiction from real-world harm, determine policy relevance, and explain reasoning for auditable decisions.

Location is onsite in Seattle, with a W-2 employment status and a standard 8:00 AM–5:00 PM PT schedule. Strong instincts in violence across fiction or real-world contexts are essential, as is experience with crisis or threat assessment and trust and safety.

Qualifications

• Applicants must show depth in violent fiction or media, or related policy work.
• Experience in military, emergency response, crisis or threat assessment is valued.
• Experience in trust & safety or content moderation helps but is not mandatory.

Responsibilities

• Evaluate user requests and AI outputs involving violence, weapons, threats within full conversation context.
• Distinguish fiction from real-world uplift or harm and assess intent and policy relevance.
• Assess whether a model's response provides meaningful real-world capability or guidance.
• Distinguish anger, frustration, or dark humor from credible threats or crisis indicators.
• Select classification in ambiguous cases with concise, policy-based rationales.
• Write and refine adversarial or borderline prompts to probe policy boundaries.
• Identify policy gaps and raise them with policy teams during calibration discussions.
• Apply policy consistently, avoiding personal beliefs in assessments.
• Maintain accuracy and attention to detail across repetitive evaluations.

Skills

Policy evaluation

Violence & fiction expertise

Crisis/threat assessment

Job description

Handshake is seeking an AI Policy Specialist to evaluate violence-related requests and model outputs. You will distinguish fiction from real-world harm, determine policy relevance, and explain reasoning for auditable decisions.

Location is onsite in Seattle, with a W-2 employment status and a standard 8:00 AM–5:00 PM PT schedule. Strong instincts in violence across fiction or real-world contexts are essential, as is experience with crisis or threat assessment and trust and safety.