Program Manager, Detection & Enforcement, Youth Safety

Discord; San Francisco (CA); On-site; USD 160,000 - 180,000; Full time

Benefits offered by this job

Wellness support

Job summary

Discord is seeking a Program Manager, Detection & Enforcement, Youth Safety to lead product and process initiatives across minor safety. You will be the internal SME across product, detection, tooling, and bugs, coordinating with cross-functional teams to improve mitigations and drive safety improvements.

The role reports to the Senior Manager of Youth Safety. This position involves exposure to disturbing content and requires delivering trauma-informed, person-centered services to prevent crimes

Qualifications

• In depth knowledge of child sexual exploitation investigation, detection, and reporting obligations for industry, equivalent of 6-10 years of project or program management
• Intermediate SQL Proficiency and technical skills
• A Bachelor’s degree
• Program management experience establishing and driving operational projects at scale
• Ability to create effective relationships, influence, and collaborate at all organizational levels
• Demonstrated experience with organizational capacity, namely building and strengthening teams at scale, as well as building and strengthening stakeholder partnerships
• Experience analyzing and mitigating high-impact threats and online threat actors, with a track record of managing tactical and strategic initiatives resulting in measurable change
• Proven leadership in developing, articulating, and advocating policies and strategies relating to teen and child safety

Responsibilities

• Drive product and process improvements
• Own product and process improvements for all NCMEC reports, CSAM enforcement, and other child sexual exploitation harms
• Manage the tooling roadmap for the team, develop and prioritize tool requests
• Audit operations and report handling, in collaboration with our QA team, to identify processing gaps and root cause issues to drive continuous improvement in detection, moderation, and tooling
• Partner with our Product Operations teams to ensure internal workflows and tools are supportive of new product launches
• Advise and guide efforts by supporting Discord stakeholder teams, including Vendor Operations, Data Engineering, Threat Research, and Policy to incorporate user safety initiatives, projects, and planning
• Ensure delivery of high quality, trauma-informed, person-centered services to prevent crimes against children and other vulnerable populations
• Work cross functionally with our Safety product team to develop ML tooling for detection and automated enforcement of high-harm groups and behavior
• Work with engineering to build out heuristic models for detection across content types, regions, and languages and harms
• Work with engineering to assess the effectiveness of image hashing, novel CSAM classifiers, and other detection for CSAM content; drive roadmap goals for detection improvements
• Conduct comprehensive product audits to understand where we can deliver more impact for young people, driving policy, product, tooling, and process recommendations
• Leverage data insights and strategic communication to make recommendations for large-scale initiatives and validate the safety-related impact and tradeoffs

Skills

Child safety domain knowledge

SQL proficiency

Bachelor's degree

Program management

Stakeholder collaboration

Threat analysis

Policy advocacy

Leadership in safety programs

Education

Bachelor's degree

Job description

Discord has a highly engaged community of millions of daily active users who use the platform for many different reasons, but there’s one thing that nearly everyone does: play video games. Discord plays a uniquely important role in the future of gaming, and we are focused on making it easier and more fun for people to hang out before, during, and after playing games.

As the Program Manager, Detection & Enforcement, Youth Safety on the Youth Safety team, you will program manage product and process initiatives that drive more effective and efficient mitigations across the minor safety remit. You will serve as the internal subject matter expert across product, detection, tooling, and bugs, including working with XFN teams to drive safety improvements. You will report into the Senior Manager of Youth Safety.

Please note: This role involves exposure to potentially disturbing topics such as child sexual abuse material, exploitation imagery, and grooming-related content. Wellness support is provided.

What You’ll be Doing:

• Drive product and process improvements
  • Recommend and drive youth safety initiatives that reduce average handle time, escalation rates, and help identify additional harms
  • Own product and process improvements for all NCMEC reports, CSAM enforcement, and other child sexual exploitation harms
  • Manage the tooling roadmap for the team, develop and prioritize tool requests
  • Audit operations and report handling, in collaboration with our QA team, to identify processing gaps and root cause issues to drive continuous improvement in detection, moderation, and tooling
  • Partner with our Product Operations teams to ensure internal workflows and tools are supportive of new product launches
  • Advise and guide efforts by supporting Discord stakeholder teams, including Vendor Operations, Data Engineering, Threat Research, and Policy to incorporate user safety initiatives, projects, and planning
  • Ensure delivery of high quality, trauma-informed, person-centered services to prevent crimes against children and other vulnerable populations
• Manage and drive the proactive detection roadmap:
  • Work cross functionally with our Safety product team to develop ML tooling for detection and automated enforcement of high-harm groups and behavior
  • Work with engineering to build out heuristic models for detection across content types, regions, and languages and harms
  • Work with engineering to assess the effectiveness of image hashing, novel CSAM classifiers, and other detection for CSAM content; drive roadmap goals for detection improvements
• Act as the liaison between our team and Product and Engineering
  • Conduct comprehensive product audits to understand where we can deliver more impact for young people, driving policy, product, tooling, and process recommendations
  • Leverage data insights and strategic communication to make recommendations for large-scale initiatives and validate the safety-related impact and tradeoffs

What You Should Have:

• In depth knowledge of child sexual exploitation investigation, detection, and reporting obligations for industry, equivalent of 6-10 years of project or program management
• Intermediate SQL Proficiency and technical skills
• A Bachelor’s degree
• Program management experience establishing and driving operational projects at scale
• Ability to create effective relationships, influence, and collaborate at all organizational levels
• Demonstrated experience with organizational capacity, namely building and strengthening teams at scale, as well as building and strengthening stakeholder partnerships
• Experience analyzing and mitigating high-impact threats and online threat actors, with a track record of managing tactical and strategic initiatives resulting in measurable change
• Proven leadership in developing, articulating, and advocating policies and strategies relating to teen and child safety

Preferred Qualifications (bonus points):

• Direct experience in creating and up-leveling harm detection strategies such as ML models, image hashing, or user reports
• Previous experience with incident management in other global trust and safety teams
• Data analysis skills

The US base salary range for this full-time position is $160,000.00 to $180,000.00 + equity + benefits. Our salary ranges are determined by role and level. Within the range, individual pay is determined by additional factors, including job-related skills, experience, and relevant education or training. Please note that the compensation details listed in US role postings reflect the base salary only, and do not include equity, or benefits.

Why Discord?

Discord plays a uniquely important role in the future of gaming. We're a multiplatform, multigenerational and multiplayer platform that helps people deepen their friendships around games and shared interests, and helps developers build and grow their businesses. We believe games give us a way to have fun with our favorite people, whether listening to music together or grinding in competitive matches for diamond rank. Join us in our mission! Your future is just a click away!

Discord is committed to inclusion and providing reasonable accommodations during the interview process. We want you to feel set up for success, so if you are in need of reasonable accommodations, please let your recruiter know.

Please see our Applicant and Candidate Privacy Policy for details regarding Discord’s collection and usage of personal information relating to the application and recruitment process by clicking HERE.