Remote AI Safety & Adversarial ML Specialist

mercor; San Francisco (CA); Hybrid; AUD 39,000 - 43,000; Full time

Job summary

Mercor is seeking AI Safety Experts for remote contract work. You will conduct red team testing on conversational AI models, focusing on jailbreaks, prompt injections, and misuse scenarios, while generating high-quality human data and reports.

You will annotate failures, classify vulnerabilities, and apply structured taxonomies to ensure consistent testing, documenting all findings for customer action.

Qualifications

• Fluent in English and Kannada.
• Prior red teaming experience in AI adversarial work, cybersecurity, or socio-technical probing.
• Ability to explain risks clearly to technical and non-technical stakeholders.

Responsibilities

• Red team conversational AI models and agents. Focus on jailbreaks, prompt injections, misuse cases, and bias exploitation.
• Generate high-quality human data. Annotate failures, classify vulnerabilities, and flag systemic risks.
• Apply structure using taxonomies, benchmarks, and playbooks to maintain consistent testing.
• Document reproducibly. Produce reports, datasets, and attack cases for customer action.

Skills

English

Kannada

Red teaming experience

Explain risks clearly

Job description

Mercor is seeking AI Safety Experts for remote contract work. You will conduct red team testing on conversational AI models, focusing on jailbreaks, prompt injections, and misuse scenarios, while generating high-quality human data and reports.

You will annotate failures, classify vulnerabilities, and apply structured taxonomies to ensure consistent testing, documenting all findings for customer action.