AI Quality Review: QA & Source Inspection (Remote)

AuraOne, Inc.; United States; Remote; USD 28,000 - 50,000; Full time

Job summary

AuraOne, Inc. is seeking a QA & Source Inspection Specialist — AI Quality Review (Remote) to evaluate AI outputs within QA workflows. This remote contractor role focuses on grading workflow correctness, policy adherence, and stakeholder fit, flagging risk, and documenting next steps for model training.

You will review outputs against playbooks, maintain inter-rater calibration scores, and provide clear written reasoning. Requires 10+ hours weekly, US-eligible, and authorized to work in the US.

Qualifications

• Experience working on QA Source Inspection Specialist operations teams.
• Ability to apply multi-page rubrics consistently.
• Clear written reasoning naming the policy/workflow being applied.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against QA source inspection operations workflows, playbooks, and firm policy.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed treatments against published playbooks or firm guidance.
• Maintain reviewer-quality scores in inter-rater calibration cycles.

Skills

QA source inspection

Policy adherence

Workflow judgment

Stakeholder communication

Operational review

Job description

AuraOne, Inc. is seeking a QA & Source Inspection Specialist — AI Quality Review (Remote) to evaluate AI outputs within QA workflows. This remote contractor role focuses on grading workflow correctness, policy adherence, and stakeholder fit, flagging risk, and documenting next steps for model training.

You will review outputs against playbooks, maintain inter-rater calibration scores, and provide clear written reasoning. Requires 10+ hours weekly, US-eligible, and authorized to work in the US.