Remote Red-Teaming QA Lead

AI Trainer Jobs; United States; Remote; USD 8,266,000 - 13,776,000; Full time

Job summary

AI Trainer Jobs, in partnership with SME Careers, seeks a Red-Teaming Quality Assurance Lead (QAL) for an hourly, remote contractor role in the United States. You will oversee quality, consistency, and trainer performance across AI red-teaming and safety-evaluation projects, review outputs, and provide precise written feedback.

You will assess risk, policy alignment, prompt quality, and rubric adherence, identify issues, communicate updates to trainers and QAs, support onboarding, and help

Qualifications

• Bachelor’s degree or professional experience in a technical or safety-related field.
• Strong written and spoken English to follow guidelines and provide feedback.
• 3+ years in AI safety, red-teaming, cybersecurity, or related workflows.

Responsibilities

• Quality monitoring: spot-check red-teaming items and provide ongoing feedback.
• Safety and red-team reviews: evaluate prompts, model responses, risk classifications and vulnerability reports.
• Trainer/QA communication: update guidelines and project changes across channels.
• Question handling: respond to trainer questions on risk categories and rubric interpretation.
• Activation management: encourage participation and track availability.
• Documentation: create and maintain red-teaming documentation and onboarding materials.
• Onboarding and training: run sessions to explain expectations and workflows.
• Quality alignment: ensure consistent application of guidelines across projects.
• Risk review: flag unsafe or poorly documented items.
• Process improvement: propose scalable QA processes for AI projects.

Skills

LLM evaluation

Policy evaluation

Safety Taxonomies

Trainer Feedback

Risk Assessment

Trust & Safety

Adversarial Testing

AI Safety

AI red-teaming

Prompt Engineering

Education

Bachelor’s degree or equivalent experience in CS or related field

Tools

Discord

Google Sheets

Google Docs

Trackers

Dashboards

Project management systems

Job description

AI Trainer Jobs, in partnership with SME Careers, seeks a Red-Teaming Quality Assurance Lead (QAL) for an hourly, remote contractor role in the United States. You will oversee quality, consistency, and trainer performance across AI red-teaming and safety-evaluation projects, review outputs, and provide precise written feedback.

You will assess risk, policy alignment, prompt quality, and rubric adherence, identify issues, communicate updates to trainers and QAs, support onboarding, and help