Trust & Safety Threat Investigations Analyst

Snap; Los Angeles (CA); On-site; USD 120,000 - 160,000; Full time

Job summary

Snap Inc. is seeking a Threat Investigations Analyst to join our Proactive Trust & Safety team in Los Angeles.

You will investigate Terms of Service and Community Guidelines violations, analyze data, and help build automated detection and enforcement rules in collaboration with Product and Engineering. You'll leverage SQL for investigations, create dashboards, and apply Python or LLM-based approaches to scale detection, measure safety impact, and train cross-functional teams on detection

Qualifications

• BA/BS or equivalent experience in abuse detection or investigations.
• 4+ years in abuse detection, enforcement, investigations.
• 2+ years SQL in investigations, querying large datasets.
• 2+ years data analysis and visualization.
• Experience in content moderation environments.

Responsibilities

• Leverage data analysis tools and query databases to conduct Terms of Service and Community Guidelines investigations, gather and analyze data and trends to draw out key insights, and document them in a way that is digestible for diverse cross-functional teams.
• Identify emerging abuse trends and vectors, and develop mitigation proposals, including automated enforcement as well as policy, process, and product improvements
• Build automated detection and enforcement rules, and maintain the rules to ensure accuracy and compliance
• Adopt and apply LLM-based approaches to scale work and expand detection capabilities
• Measure progress and monitor trends through metrics that reflect mitigations' effectiveness and safety impact
• Work with scaled review teams as necessary to ensure seamless support for scaled safety, including training and ongoing calibration
• Provide training and guidance to other T&S and cross-functional team members on detection and prevention techniques
• Enhance and streamline the team's work through the identification of opportunities to improve internal investigation and detection tools

Skills

Data analysis

SQL

Dashboard visualization

Communication skills

Problem solving

Independent work

Ambiguity navigation

Education

BA/BS degree or equivalent

Tools

Looker/Tableau

Python

LLM tooling

Job description

Snap Inc is a technology company. We believe the camera presents the greatest opportunity to improve the way people live and communicate. Snap contributes to human progress by empowering people to express themselves, live in the moment, learn about the world, and have fun together.

The Company operates Snapchat , a visual messaging app that enhances your relationships with friends, family, and the world, and Specs Inc. , a wholly-owned subsidiary dedicated to making computing more human, in addition to Bitmoji , Saturn, and other digital services.

Snap Inc. is a camera company. We believe that reinventing the camera represents our greatest opportunity to improve the way people live and communicate. Our products empower people to express themselves, live in the moment, learn about the world, and have fun together.

Snapchat is a camera and messaging app that connects people to their friends and the world. Every day around the globe, millions of people use Snapchat to communicate with friends, build relationships, play, and learn. No matter where you are or how you express yourself, it's always the fastest way to share a moment!

We're looking for a Threat Investigations Analyst to join our growing Proactive Trust & Safety (T&S) team. In this role you will use your technical acumen, problem-solving skills and inquisitive mindset to investigate and analyze Terms of Service and Community Guidelines violations, including those involving sensitive content. You will use the insights you derive to build automated detection and enforcement rules, propose innovative safety mitigations, improve operational efficiency, and make recommendations for safety-oriented policy and product enhancements. You will work closely with cross-functional partners, particularly those on the Product and Engineering teams, and be responsible for tracking key metrics that measure our progress.

What you'll do

• Leverage data analysis tools and query databases to conduct Terms of Service and Community Guidelines investigations, gather and analyze data and trends to draw out key insights, and document them in a way that is digestible for diverse cross-functional teams.
• Identify emerging abuse trends and vectors, and develop mitigation proposals, including automated enforcement as well as policy, process, and product improvements
• Build automated detection and enforcement rules, and maintain the rules to ensure accuracy and compliance
• Adopt and apply LLM-based approaches to scale work and expand detection capabilities
• Measure progress and monitor trends through metrics that reflect mitigations' effectiveness and safety impact
• Work with scaled review teams as necessary to ensure seamless support for scaled safety, including training and ongoing calibration
• Provide training and guidance to other T&S and cross-functional team members on detection and prevention techniques
• Enhance and streamline the team's work through the identification of opportunities to improve internal investigation and detection tools

Knowledge, Skills & Abilities

• Ability to analyze, manipulate, and identify insights from quantitative and qualitative data; create visuals, dashboards, and reports to effectively communicate your insights (ideally using Looker, Tableau, or other similar programs); and make data-informed decisions
• Excellent problem-solving and critical thinking skills with strong attention to detail
• Ability to concurrently manage multiple high-priority projects end to end
• Strong work ethic and demonstrated ability to work both independently and with peers
• Skilled at exercising high-level judgment and navigating ambiguity in a fast-paced, dynamic environment
• Excellent verbal and written communication skills, including the ability to describe technical implementations or analyses to a non-technical audience in an effective manner
• Knowledge of emerging online abuse trends, adversarial behaviors, and industry approaches to platform safety

Minimum Qualifications

• BA/BS degree or equivalent work experience
• 4+ years of relevant experience in abuse detection, enforcement, and/or investigations
• 2+ years of experience applying SQL in investigations work, including independently querying large datasets, joining multiple data sources, and identifying trends, patterns, and anomalous behavior
• 2+ years of experience in data analysis and visualization, including identifying trends and drawing insights from quantitative and qualitative data
• Comfort working within a content moderation environment with frequent exposure to sensitive content
• Flexible working hours: ability to work evenings and/or weekends on occasion if the need arises

Preferred Qualifications

• Experience with Python or other scripting languages
• Experience developing scalable safety solutions
• Experience working with product and engineering teams to develop tools and solutions that improve trust across a platform or product
• Experience with LLM prompt engineering or LLM agent development
• Experience building and