Remote AI QA Specialist — Product & Engineering Ops

AuraOne; United States; On-site; USD 55,000 - 83,000; Part time

Job summary

AuraOne seeks a Product & Engineering Expert to remotely evaluate AI outputs across product engineering specialist operations. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next steps so the modeling team can train on it.

The role is a CONTRACTOR position, US-eligible, with hourly compensation to be confirmed after interview. Candidates should have direct experience in product engineering operations, strong rubric

Qualifications

• Direct working experience in product engineering specialist operations on real teams.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning naming the policy or workflow used.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against product engineering workflows, playbooks, and policy for Product & Engineering Expert assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed playbooks calls against firm guidance.
• Maintain reviewer-quality scores in inter-rater calibration cycles.

Skills

Product engineering ops

Rubric application

Policy/workflow naming

Attention to detail

Async availability

Job description

AuraOne seeks a Product & Engineering Expert to remotely evaluate AI outputs across product engineering specialist operations. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next steps so the modeling team can train on it.

The role is a CONTRACTOR position, US-eligible, with hourly compensation to be confirmed after interview. Candidates should have direct experience in product engineering operations, strong rubric