Remote AI Quality Reviewer - Policy, Workflow & Risk

AuraOne, Inc.; United States; Remote; USD 55,000 - 83,000; Full time

Job summary

AuraOne, Inc. is seeking a Member of Technical Staff, Quality Engineering (Remote) to review AI outputs across operations workflows. This role focuses on applying policy, workflow rules, and escalation criteria to ensure high-quality results.

The position requires strong attention to detail, clear written reasoning, and reliable async availability for at least 10 hours per week. Remote US-eligible engagement with ongoing model-training support.

Qualifications

• Direct working experience in member of technical staff quality engineering specialist operations on real teams.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the policy or workflow being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current workflows, playbooks, and policy for assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed playbook calls using firm guidance.
• Maintain reviewer-quality scores in inter-rater calibration cycles.

Skills

Operational review

Policy adherence

Workflow judgment

Stakeholder communication

Quality engineering operations

Job description

AuraOne, Inc. is seeking a Member of Technical Staff, Quality Engineering (Remote) to review AI outputs across operations workflows. This role focuses on applying policy, workflow rules, and escalation criteria to ensure high-quality results.

The position requires strong attention to detail, clear written reasoning, and reliable async availability for at least 10 hours per week. Remote US-eligible engagement with ongoing model-training support.