AI Safety & Strategy Lead

Handshake; Seattle (WA); On-site; USD 144,000 - 176,000; Full time

Benefits offered by this job

Equity

401(k) match

Parental leave

Fertility benefits

Medical, dental, vision

Mental health support

Learning stipend

Remote & office

Job summary

Handshake is seeking a Strategic Projects Lead (SPL), Safety, to own large-scale human data programs powering frontier AI model training and evaluation. You will design, build, and run workflows for model policy annotation and evaluations across policy areas, informing training, evaluation, and enforcement decisions.

You will collaborate with frontier AI labs and senior stakeholders, manage annotator teams, and drive scale while handling ambiguous situations.

Qualifications

• 2+ years of experience in trust and safety, policy enforcement, regulatory compliance, risk management, management consulting, government or related field

Responsibilities

• Design and architect annotation frameworks and labeling workflows that scale effectively while maintaining high precision, accuracy, and inter-rater agreement
• Lead, mentor, and manage a team of trusted annotators, fostering a culture of precision, consistency, and care given the sensitive nature of the work while addressing complex edge cases, and identify policy inconsistencies
• Collaborate with policy leads to offer organized insights regarding gaps, classification ambiguities, and nuanced scenarios derived from practical data annotation
• Construct and iterate on detailed annotation playbooks and auditor resources to drive precision and alignment across diverse datasets and regulatory domains
• Detect and surface novel data trends, systemic labeling errors, and strategic opportunities to harden and mature internal safety policies
• Partner directly with frontier AI labs and senior stakeholders to shape scope, resolve issues, and expand model policy programs through execution

Skills

Trust and safety

Policy enforcement

Regulatory compliance

Analytical skills

Stakeholder management

Tools

SQL

Job description

Handshake is seeking a Strategic Projects Lead (SPL), Safety, to own large-scale human data programs powering frontier AI model training and evaluation. You will design, build, and run workflows for model policy annotation and evaluations across policy areas, informing training, evaluation, and enforcement decisions.

You will collaborate with frontier AI labs and senior stakeholders, manage annotator teams, and drive scale while handling ambiguous situations.