AI Safety Red Team Analyst: Content Adversarial Testing

Welo Data; Manila; On-site; PHP 864,000 - 1,296,000; Part time

Job summary

Welo Data in the Philippines is seeking a Content Adversarial Red Team Analyst to test AI platforms against safety policies and compliance requirements. You will design and execute challenging test scenarios, developing diverse prompts and edge-case inputs to probe system behaviour.

The role is freelance with potential to convert to full-time, paying US$10 per hour, and requires strong written English, analytical thinking, and attention to detail.

Qualifications

• Educational background or equivalent experience in Trust & Safety, Content Safety, Policy, Linguistics, Communications, Journalism, Research, AI Evaluation, or a related field.
• Experience in content safety, trust and safety, AI evaluation, content moderation, policy enforcement, quality assurance, or related areas.
• Strong understanding of content safety policies, policy enforcement, and common safety risks.
• Strong understanding of written language, context, intent, and different ways users may communicate.
• Ability to think creatively and develop challenging, unusual, or unexpected test scenarios.
• Strong analytical and critical-thinking skills.
• Ability to identify patterns, weaknesses, inconsistencies, and gaps in system behaviour.
• Comfortable working with complex or ambiguous situations and making informed decisions based on defined requirements.
• Ability to understand and consistently apply detailed testing guidelines and policies.
• Strong written English comprehension and communication skills.
• Strong documentation skills and attention to detail.
• Familiarity with AI systems, large language models, adversarial testing, red teaming, or AI safety is preferred.

Responsibilities

• Design and execute authorized adversarial test scenarios to evaluate AI systems against content safety policies and compliance requirements.
• Develop diverse and challenging prompts, inputs, and scenarios to test system behaviour.
• Explore edge cases, unusual inputs, and complex situations that may reveal gaps in safety controls or policy enforcement.
• Evaluate AI responses and identify potential weaknesses, inconsistencies, or policy-related concerns.
• Test how systems respond to different forms of language, context, intent, and user behaviour.
• Identify recurring patterns or scenarios that may require further testing or improvement.
• Document test scenarios, system responses, findings, and supporting evidence clearly.
• Apply defined testing guidelines and project requirements consistently.
• Review complex cases and use sound judgment when assessing system behaviour.
• Maintain high levels of quality, accuracy, and attention to detail while completing assigned tasks.

Skills

Analytical thinking

Creative thinking

Attention to detail

Written English

Documentation skills

Problem solving

Education

Relevant field degree or equivalent experience

Tools

Adversarial testing methods

Job description

Welo Data in the Philippines is seeking a Content Adversarial Red Team Analyst to test AI platforms against safety policies and compliance requirements. You will design and execute challenging test scenarios, developing diverse prompts and edge-case inputs to probe system behaviour.

The role is freelance with potential to convert to full-time, paying US$10 per hour, and requires strong written English, analytical thinking, and attention to detail.