Remote AI Safety Red-Team Reviewer

AI Trainer Jobs; United States; Remote; USD 90,000 - 96,000; Full time

Job summary

AuraOne is seeking a contractor to perform a Refusal Preference Preference Data Reviewer role. Remote work within the US is available, with hourly compensation and responsibilities focused on adversarial evaluation and documentation.

You'll design jailbreak scenarios, document failures with rigor, and help patch gaps before models ship. Expect to operate as an independent specialist with strong reporting and communication skills.

Qualifications

• Background in offensive security, AppSec, or trust & safety operations.
• Experience publishing or reproducing public adversarial-ML research.
• Multilingual fluency for cross-language attack testing.

Responsibilities

• Design adversarial prompts that probe known weakness classes for Refusal Preference Preference Data Reviewer assignments.
• Document every successful attack with reproduction steps and the policy clause it violated.
• Score model defenses across single-turn and multi-turn conversations.
• Triage emerging attack vectors and route them to the safety team with severity ratings.

Skills

Adversarial prompting

Red-team analysis

Policy taxonomy

Failure documentation

Refusal Preference Data evaluation

Preference ranking

RLHF

Rater calibration

Refusal

Preference

Job description

AuraOne is seeking a contractor to perform a Refusal Preference Preference Data Reviewer role. Remote work within the US is available, with hourly compensation and responsibilities focused on adversarial evaluation and documentation.

You'll design jailbreak scenarios, document failures with rigor, and help patch gaps before models ship. Expect to operate as an independent specialist with strong reporting and communication skills.