Remote Code Refactor QA Reviewer (Contractor)

AuraOne, Inc.; United States; Remote; USD 55,000 - 96,000; Part time

Benefits offered by this job

Ops QA experience

AI workflow tooling familiarity

Bilingual experience

Job summary

AuraOne, Inc. seeks a Code Refactor Workflow Reviewer for remote engagement to assess AI outputs across code refactor workflows.

You will review outputs against playbooks, assess tone, policy adherence, and stakeholder fit, and document the recommended next steps for training the modeling team. This contractor role requires strong attention to detail, experience applying rubrics across large batches, and clear reasoning that cites the applicable policy.

Qualifications

• Direct working experience in code refactor workflow specialist operations on real teams for Code Refactor Workflow Reviewer work.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the policy or workflow being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Grade a model's response to a real code refactor workflow specialist operations ticket and rate workflow, tone, and escalation.
• Flag a missed escalation with the right severity tag and corrected next step.
• Adjudicate a disputed playbook call between two reviewers using firm guidance.
• Audit a 25-row batch for rubric consistency and report drift to the program lead.

Skills

Operational review

Policy adherence

Workflow judgment

Stakeholder communication

Code review

Software testing

Agent evaluation

Code

Refactor

Job description

AuraOne, Inc. seeks a Code Refactor Workflow Reviewer for remote engagement to assess AI outputs across code refactor workflows.

You will review outputs against playbooks, assess tone, policy adherence, and stakeholder fit, and document the recommended next steps for training the modeling team. This contractor role requires strong attention to detail, experience applying rubrics across large batches, and clear reasoning that cites the applicable policy.