AI Workflow Escalation Reviewer (Remote)

AuraOne, Inc.; United States; Remote; USD 34,000 - 55,000; Part time

Job summary

AuraOne, Inc. seeks an independent contractor for an AI data reviewer role. The position involves evaluating workflow escalation AI outputs, tagging responses, and ensuring quality through structured documentation. Candidates must have prior evaluation experience.

This role is remote and requires reliable availability for at least 10 hours per week. Applicants must be authorized to work in the US. Compensation includes an hourly rate confirmed after the interview process.

Qualifications

• Prior evaluation, annotation, or human-rater experience required.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the issue being evaluated.

Responsibilities

• Evaluate AI model outputs against a rubric and assign severity tags.
• Compare paired responses and select the stronger answer with rationale.
• Document recurring failure modes for the modeling team.

Skills

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

Workflow Escalation Workflow AI review

Operational judgment

Job description

AuraOne, Inc. seeks an independent contractor for an AI data reviewer role. The position involves evaluating workflow escalation AI outputs, tagging responses, and ensuring quality through structured documentation. Candidates must have prior evaluation experience.

This role is remote and requires reliable availability for at least 10 hours per week. Applicants must be authorized to work in the US. Compensation includes an hourly rate confirmed after the interview process.