Remote AI Safety Red-Team Risk Evaluator

AI Trainer Jobs; United States; Remote; USD 90,000 - 96,000; Full time

Job summary

AI Trainer Jobs seeks a Harmful Instruction Refusal Risk Evaluator for a remote red-team track that stress-tests AI systems against adversarial prompts. Reviewers craft attack scenarios, document failures, and pair each jailbreak with the violated rubric clause to help patch gaps.

AuraOne safety team collaborates to harden models before shipping. Adversarial evaluation is performed with rigorous write-ups, enabling reproducibility and regression testing by the modeling team.

Qualifications

• Proven red-team adversarial testing experience.
• Document attack scenarios with reproducible steps.
• Score defenses across single-turn and multi-turn conversations.
• Available for at least 10 hours per week.

Responsibilities

• Design adversarial prompts that probe known weakness classes.
• Document every successful attack with reproduction steps.
• Score model defenses across conversations.
• Triage emerging attack vectors for safety teams.

Skills

Adversarial prompting

Red-team analysis

Policy taxonomy

Failure documentation

Harmful instruction refusal

AI safety

Red-team evaluation

Policy rubrics

Job description

AI Trainer Jobs seeks a Harmful Instruction Refusal Risk Evaluator for a remote red-team track that stress-tests AI systems against adversarial prompts. Reviewers craft attack scenarios, document failures, and pair each jailbreak with the violated rubric clause to help patch gaps.

AuraOne safety team collaborates to harden models before shipping. Adversarial evaluation is performed with rigorous write-ups, enabling reproducibility and regression testing by the modeling team.