Remote Red-Teaming QA Lead - AI Safety & Evaluation

OpenTrain AI; United States; On-site; USD 117,000 - 158,000; Part time

Job summary

OpenTrain is hiring a Red‑Teaming Quality Assurance Lead to oversee quality, consistency, and contributor performance across red‑teaming and safety evaluation projects. You will evaluate AI‑generated safety work and trainer/QA submissions against rubrics, then provide clear, actionable feedback.

This hourly contract role is remote with United States hiring, requiring 20+ hours/week and paying $100 per hour.

Qualifications

• Proven experience reviewing AI red-teaming, safety evaluations, or rubric-based QA work.
• Ability to assess adversarial prompts, risk analyses, and trainer/QA submissions for quality and policy alignment.
• Familiarity with adversarial prompting, jailbreak patterns, misuse scenarios, and harmful-content taxonomies.

Responsibilities

• Review adversarial prompts, model responses, risk classifications, safety analyses, policy explanations, and vulnerability reports for accuracy, realism, and usefulness.
• Spot-check trainer and QA submissions, escalate recurring issues, and reinforce quality standards across projects.
• Provide precise written feedback against project guidelines and rubrics—focus on rubric adherence, instruction-following, formatting, and scenario realism.
• Communicate updates, workflow changes, and review expectations to trainers and QAs in remote collaboration channels.
• Support onboarding, documentation, FAQs, trackers, calibration tasks, and process improvements.
• Help manage contributor activation and follow-up when team members are inactive or inconsistent.

Job description

OpenTrain is hiring a Red‑Teaming Quality Assurance Lead to oversee quality, consistency, and contributor performance across red‑teaming and safety evaluation projects. You will evaluate AI‑generated safety work and trainer/QA submissions against rubrics, then provide clear, actionable feedback.

This hourly contract role is remote with United States hiring, requiring 20+ hours/week and paying $100 per hour.