GenAI Content Red Team Specialist

TikTok; San Francisco (CA); On-site; USD 130,000 - 272,000; Full time

Benefits offered by this job

Medical Insurance

Dental Insurance

Vision Insurance

401(k) Match

Parental Leave

Disability Insurance

Life Insurance

Wellbeing Benefits

Paid Holidays

Paid Sick Days

Paid Personal Time

Job summary

TikTok’s Global Operations team seeks an AI Content Red Team Analyst for Trust & Safety in San Francisco. You will conduct adversarial testing of GenAI models, document risk, reproduce steps, and provide actionable mitigations across product and policy teams.

The role demands strong judgment, analytical rigor, and clear communication of complex findings. Work closely with policy, product, and engineering to strengthen safety before and after launch, and help shape testing playbooks, risk

Qualifications

• Minimum 3 years of experience in Trust & Safety, cybersecurity, risk/adversarial testing, or related fields.
• Experience with prompt testing, jailbreak analysis, LLM evaluation, or adversarial QA.
• Familiarity with AI safety risks (jailbreaks, hallucinations, bias, misuse patterns).
• Strong interest in GenAI safety, and the ways AI systems can be compromised under adversarial conditions.
• Demonstrated ability to independently investigate ambiguous problems, identify non-obvious failure modes and abuse patterns, and produce clear, evidence-based conclusions.
• Ability to manage multiple priorities, and collaborate effectively with cross-functional teams.

Responsibilities

• Conduct structured adversarial testing on AI models, features, and policies to identify vulnerabilities and emerging risks.
• Explore product behavior across contexts and user journeys, to identify model failure modes that may not be captured in standard evaluations.
• Investigate jailbreaks, evasions, prompt-based attacks, and other adversarial techniques relevant to content safety.
• Document findings clearly and consistently, including risk descriptions, reproduction steps, severity assessments, and mitigation recommendations.
• Partner with cross functional stakeholders (policy, product, business teams) to ensure mitigation validation and root cause closure.
• Support development of testing playbooks, taxonomies, and internal knowledge bases.
• Stay updated on emerging adversarial trends (e.g., deepfakes, multimodal manipulation, coordinated abuse), and shifts in the external risk landscape.

Skills

Trust & Safety

Cybersecurity

Adversarial Testing

GenAI Safety

LLM Evaluation

Prompt Testing

Jailbreak Analysis

Cross-functional Collaboration

Tools

Agentic AI Tools

Job description

TikTok’s Global Operations team seeks an AI Content Red Team Analyst for Trust & Safety in San Francisco. You will conduct adversarial testing of GenAI models, document risk, reproduce steps, and provide actionable mitigations across product and policy teams.

The role demands strong judgment, analytical rigor, and clear communication of complex findings. Work closely with policy, product, and engineering to strengthen safety before and after launch, and help shape testing playbooks, risk