Remote QA Reviewer - Virtual Assistant Ops (Contractor)

AuraOne Human Data; United States; Remote; USD 34,000 - 55,000; Full time

Job summary

AuraOne Human Data seeks a contractor for remote review of AI outputs within virtual assistant operations. You will evaluate alignment with workflows, policy, and stakeholder expectations, scoring quality and rigor through structured rubrics.

Responsibilities include flagging risks, documenting next steps for model training, and ensuring consistency across multi-page rubrics and long review batches. Flexible, remote collaboration is expected.

Qualifications

• Experience reviewing real VA operations on production teams.
• Ability to apply and cite policies during reviews.
• Adept at scoring workflow and tone against rubrics.
• Clear written reasoning explaining policy/workflow decisions.
• Reliability for asynchronous collaboration across regions.

Responsibilities

• Review AI outputs against VA operations workflows, playbooks, and firm policy.
• Grade tone, escalation logic, and stakeholder fit using a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed playbook calls using firm guidance.
• Maintain reviewer-quality scores in inter-rater calibration cycles.

Skills

Operational review

Policy adherence

Workflow judgment

Stakeholder communication

Virtual Assistant operations

Bilingual experience

Job description

AuraOne Human Data seeks a contractor for remote review of AI outputs within virtual assistant operations. You will evaluate alignment with workflows, policy, and stakeholder expectations, scoring quality and rigor through structured rubrics.

Responsibilities include flagging risks, documenting next steps for model training, and ensuring consistency across multi-page rubrics and long review batches. Flexible, remote collaboration is expected.