Remote AI Operations QA & Policy Auditor

AuraOne; United States; On-site; USD 34,000 - 69,000; Full time

Job summary

AuraOne seeks a remote Business Analyst / Researcher / Operations Specialist to evaluate AI outputs and grade workflow adherence as part of contractor operations. You will review models against playbooks, policy, and stakeholder needs, and document actionable next steps for training.

Ideal candidates bring direct experience in business analysis or operations, and can apply multi-page rubrics across large batches with clear, policy-based reasoning.

Qualifications

• Direct working experience in business analyst / researcher / operations on real teams.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning that names the policy or workflow applied.
• Strong attention to detail and ability to flag issues with prompts.

Responsibilities

• Review AI outputs against workflows, playbooks, and policy for assignments.
• Grade tone, escalation logic, and stakeholder fit on a rubric.
• Flag operational risk, missed escalations, and policy gaps with severity tags.
• Capture the right next step for model training.
• Adjudicate disputes against firm guidance.
• Maintain reviewer quality scores in calibration cycles.

Skills

Operational review

Policy adherence

Workflow judgment

Stakeholder communication

AI model evaluation

Job description

AuraOne seeks a remote Business Analyst / Researcher / Operations Specialist to evaluate AI outputs and grade workflow adherence as part of contractor operations. You will review models against playbooks, policy, and stakeholder needs, and document actionable next steps for training.

Ideal candidates bring direct experience in business analysis or operations, and can apply multi-page rubrics across large batches with clear, policy-based reasoning.