Remote AI Safety Red Team Specialist

Mercor; San Francisco (CA); Remote; USD 120,000 - 170,000; Full time

Job summary

Mercor is assembling a remote red team of human data experts to probe AI models with adversarial inputs, surface vulnerabilities, and generate safe, structured data for clients. The role focuses on testing jailbreaks, prompt injections, bias exploitation, and misuse cases across multi-turn conversations.

You will annotate failures, classify vulnerabilities, and produce reproducible reports and datasets that help customers strengthen their AI systems.

Qualifications

• You bring strong judgment about language and content: you can tell whether an AI response is accurate, complete, and appropriate, and explain why.
• You’re rigorous: you notice subtle errors, inconsistencies, and gaps that others skim past.
• You’re structured: you work to guidelines and quality standards consistently, not ad hoc.
• You’re communicative: you explain your reasoning clearly to technical and non-technical audiences.

Responsibilities

• Red team conversational AI models and agents: jailbreaks, prompt injections, misuse cases, bias exploitation, multi-turn manipulation
• Generate high-quality human data: annotate failures, classify vulnerabilities, and flag systemic risks
• Apply structure: follow taxonomies, benchmarks, and playbooks to keep testing consistent
• Document reproducibly: produce reports, datasets, and attack cases customers can act on

Skills

Judgment on content

Rigorous attention to detail

Structured approach

Clear communicator

Adaptable

Job description

Mercor is assembling a remote red team of human data experts to probe AI models with adversarial inputs, surface vulnerabilities, and generate safe, structured data for clients. The role focuses on testing jailbreaks, prompt injections, bias exploitation, and misuse cases across multi-turn conversations.

You will annotate failures, classify vulnerabilities, and produce reproducible reports and datasets that help customers strengthen their AI systems.