Remote AI Safety & Red Team Specialist

Mercor; San Francisco (CA); Remote; USD 120,000 - 180,000; Full time

Job summary

Mercor is building a remote AI safety red team to probe models with adversarial inputs, surface vulnerabilities, and generate red team data for safer AI systems. The role involves reviewing AI outputs on sensitive topics, with optional involvement in higher-sensitivity projects guided by clear guidelines and wellness resources.

You will red-team conversational AI models, annotate failures, document reproducible reports, and help strengthen customer AI systems across diverse projects.

Qualifications

• Experience conducting red-team assessments on AI systems.
• Ability to articulate risks clearly to technical and non-technical stakeholders.
• Structured thinker using benchmarks and playbooks to guide testing.

Responsibilities

• Red team conversational AI models and agents: jailbreaks, prompt injections, misuse cases, bias exploitation, multi-turn manipulation
• Generate high-quality human data: annotate failures, classify vulnerabilities, and flag systemic risks
• Apply structure: follow taxonomies, benchmarks, and playbooks to keep testing consistent
• Document reproducibly: produce reports, datasets, and attack cases customers can act on

Skills

Red teaming

Adversarial ML

Cybersecurity

Socio-technical risk

Creative probing

Job description

Mercor is building a remote AI safety red team to probe models with adversarial inputs, surface vulnerabilities, and generate red team data for safer AI systems. The role involves reviewing AI outputs on sensitive topics, with optional involvement in higher-sensitivity projects guided by clear guidelines and wellness resources.

You will red-team conversational AI models, annotate failures, document reproducible reports, and help strengthen customer AI systems across diverse projects.