Chief Trust & Safety Leader, Education AI

MagicSchool AI; Denver (CO); Remote; USD 140,000 - 200,000; Full time

Benefits offered by this job

Unlimited time off

Employer-paid health insurance

Stock options

401k match

Monthly wellness stipend

Job summary

MagicSchool AI is seeking a Senior Safety Lead to own trust & safety for a youth-facing AI platform. You will drive policy, guardrails, evaluations, and incident response while coordinating with Legal on COPPA/FERPA and state frameworks.

You will build and lead a small safety team (1–3 to start) and scale through 2027, shaping safety as a core product capability for educators and students worldwide.

Qualifications

• Must have owned trust & safety or responsible AI for consumer/youth product at scale.
• Hands-on with LLM safety: evals, classifiers, guardrails, red-teaming.
• Safety as infrastructure to speed shipping with confidence.
• Ability to make judgments under ambiguity and communicate them publicly.
• Strong writing for safety docs and district explainers.

Responsibilities

• Own AI safety for teachers and students: policy, guardrails, evals, red-teaming, incident response.
• Manage district trust: safety docs, RFP responses, state guidance alignment.
• Make safety a core part of product infra with acceptance criteria.
• Own student-facing safety: age-appropriate content, crisis handling, escalation paths.
• Run end-to-end safety incident process and postmortems.
• Collaborate with Legal on COPPA/FERPA and state laws.
• Build and lead a safety team (1-3 to start) and scale through 2027.

Job description

MagicSchool AI is seeking a Senior Safety Lead to own trust & safety for a youth-facing AI platform. You will drive policy, guardrails, evaluations, and incident response while coordinating with Legal on COPPA/FERPA and state frameworks.

You will build and lead a small safety team (1–3 to start) and scale through 2027, shaping safety as a core product capability for educators and students worldwide.