Remote AI Operations QA Reviewer

AI Trainer Jobs; United States; Remote; USD 110,000 - 124,000; Full time

Job summary

AI Trainer Jobs is seeking a remote reviewer to evaluate AI outputs across computer user support specialists workflows. Reviewers grade workflow correctness, policy adherence, stakeholder fit; flag operational risk; and document the right next steps so the modeling team can train on it.

This contractor role offers hourly pay of $85, remote-US eligible, with flexible hours (at least 10 hours per week) and an independent schedule.

Qualifications

• Direct working experience in computer user support specialists operations on real teams.
• Experience applying multi-page rubrics consistently.
• Clear written reasoning that names the policy or workflow being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current computer user support specialists operations workflows, playbooks, and firm policy for assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.

Skills

Experience in operations

Rubrics experience

Written reasoning

Attention to detail

Async availability

Tools

AI-assisted workflow tooling

Job description

AI Trainer Jobs is seeking a remote reviewer to evaluate AI outputs across computer user support specialists workflows. Reviewers grade workflow correctness, policy adherence, stakeholder fit; flag operational risk; and document the right next steps so the modeling team can train on it.

This contractor role offers hourly pay of $85, remote-US eligible, with flexible hours (at least 10 hours per week) and an independent schedule.