Remote AI Adversarial Red‑Team Evaluator

AI Trainer Jobs; United States; Remote; USD 83,000 - 165,000; Full time

Benefits offered by this job

Remote work

Contractor

Job summary

AuraOne is seeking a Remote Secure Code Review AI Evaluator to design adversarial prompts, document failures with reproducible steps, and pair each jailbreak with the violated rubric.

You will assess defenses in single-turn and multi-turn conversations, triage new attack vectors, and maintain a library of red-team rubrics. This is a contractor role with hourly pay to be set after interview, contingent on program demand.

Qualifications

• Experience red-teaming AI systems, security research, or adversarial ML work.
• Strong written communication — your reports become the patch ticket.
• Comfort working in policy-grey areas with clear documentation of what was attempted and why.
• Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies.
• Multilingual fluency for cross-language attack testing.

Responsibilities

• Design adversarial prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for Secure Code Review AI Evaluator assignments.
• Document every successful attack with reproduction steps and the policy clause it violated.
• Score model defenses across single-turn and multi-turn conversations.
• Triage emerging attack vectors and route them to the safety team with severity ratings.
• Maintain a personal library of attack patterns and propose new red-team rubrics.

Skills

Adversarial prompting

Red-team analysis

Policy taxonomy

Failure documentation

Secure Code Review AI evaluation

Cybersecurity

AI evaluation

Rubric writing

Expert review

Job description

AuraOne is seeking a Remote Secure Code Review AI Evaluator to design adversarial prompts, document failures with reproducible steps, and pair each jailbreak with the violated rubric.

You will assess defenses in single-turn and multi-turn conversations, triage new attack vectors, and maintain a library of red-team rubrics. This is a contractor role with hourly pay to be set after interview, contingent on program demand.