Remote AI Safety Red Team Specialist

Obsidian; Dubai; Remote; AED 167,000 - 279,000; Full time

Job summary

Mercor is building a remote red team for testing AI safety. You will adversarially probe conversational AI models, craft jailbreaks, tests, and classify vulnerabilities with structured playbooks.

You’ll generate high-quality human data, annotate failures, and deliver reproducible reports and datasets to help customers strengthen their AI systems. English and Malayalam fluency is essential.

Qualifications

• Native fluency in English and Malayalam is required for this position.
• You bring strong judgment about language and content, able to evaluate AI outputs for accuracy, completeness, and appropriateness.

Responsibilities

• Red team conversational AI models and agents: jailbreaks, prompt injections, misuse cases, bias exploitation, multi-turn manipulation.
• Generate high-quality human data: annotate failures, classify vulnerabilities, and flag systemic risks.
• Apply structure: follow taxonomies, benchmarks, and playbooks to keep testing consistent.
• Document reproducibly: produce reports, datasets, and attack cases customers can act on.

Skills

English

Malayalam

Job description

Mercor is building a remote red team for testing AI safety. You will adversarially probe conversational AI models, craft jailbreaks, tests, and classify vulnerabilities with structured playbooks.

You’ll generate high-quality human data, annotate failures, and deliver reproducible reports and datasets to help customers strengthen their AI systems. English and Malayalam fluency is essential.