AI QA Reviewer: 211 Operations (Remote Contractor)

AuraOne, Inc.; United States; On-site; USD 34,000 - 83,000; Full time

Job summary

You will grade tone, escalation logic, and policy adherence on a structured rubric, flag risks, and help ensure quality and reliability in automated tasks. This is a contractor role with flexible hours, requiring at least 10 hours per week and US work authorization.

Qualifications

• Direct working experience in 211 specialist operations on real teams.
• Clear written reasoning that names the policy or workflow being applied.
• Strong attention to detail and ability to flag when a prompt is the problem.

Responsibilities

• Review AI outputs against 211 specialist operations workflows, playbooks, and firm policy for 211 Specialist assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed treatments against published playbooks or firm guidance.
• Maintain reviewer-quality scores in inter-rater calibration cycles.

Skills

Operational review

Policy adherence

Workflow judgment

Stakeholder communication

211 specialist operations

Tools

AI tooling

Job description

You will grade tone, escalation logic, and policy adherence on a structured rubric, flag risks, and help ensure quality and reliability in automated tasks. This is a contractor role with flexible hours, requiring at least 10 hours per week and US work authorization.