AI Product & Artifacts QA Reviewer (Remote)

AuraOne; United States; On-site; USD 110,000 - 220,000; Full time

Benefits offered by this job

Remote work

Job summary

AuraOne is seeking contractors for a remote review track to evaluate AI outputs across Product / Artifacts Experts workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train on it.

This remote contractor role requires direct experience in Product / Artifacts Experts operations, strong rubric application, and reliable async availability for at least 10 hours per week.

Qualifications

• Direct working experience in product / artifacts experts specialist operations on real teams.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the policy or workflow being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current product / artifacts experts specialist operations workflows, playbooks, and firm policy for Product / Artifacts Experts assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed treatments against published playbooks or firm guidance.
• Maintain reviewer-quality scores in inter-rater calibration cycles.

Job description

AuraOne is seeking contractors for a remote review track to evaluate AI outputs across Product / Artifacts Experts workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train on it.

This remote contractor role requires direct experience in Product / Artifacts Experts operations, strong rubric application, and reliable async availability for at least 10 hours per week.