Remote AI Operations QA Lead — Policy & Workflow

AuraOne; United States; On-site; USD 68,880 - 165,312; Part time

Job summary

AuraOne is seeking a Technical Lead contractor to evaluate AI outputs across specialist operations workflows. You will review responses for tone, policy adherence, and stakeholder alignment, applying structured rubrics to ensure high-quality decisions.

Remote, US-eligible role with an emphasis on documenting the right next steps so the modeling team can train on it, and on clear, written reasoning that identifies the policy or workflow applied.

Qualifications

• Operational review of AI outputs in technical lead operations
• Clear, policy-based reasoning for assessments
• Ability to apply rubrics consistently across batches
• Strong attention to detail and critical thinking
• Ability to work asynchronously at least 10 hours per week

Responsibilities

• Review AI outputs against workflows, playbooks, and firm policy for Technical Lead tasks
• Grade tone, escalation logic, and stakeholder fit on a structured rubric
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags
• Capture the next steps for modeling team training
• Adjudicate disputed playbook calls using firm guidance
• Maintain reviewer-quality scores in calibration cycles

Skills

Operational review

Policy adherence

Workflow judgment

Stakeholder communication

Tech lead ops

C#

C++

.NET

Node.js

PHP

Python

React

Tools

C#

C++

.NET

Node.js

PHP

Python

React

Job description

AuraOne is seeking a Technical Lead contractor to evaluate AI outputs across specialist operations workflows. You will review responses for tone, policy adherence, and stakeholder alignment, applying structured rubrics to ensure high-quality decisions.

Remote, US-eligible role with an emphasis on documenting the right next steps so the modeling team can train on it, and on clear, written reasoning that identifies the policy or workflow applied.