Remote AI QA Analyst — EA/Admin Operations

AuraOne; United States; On-site; USD 55,000 - 110,000; Part time

Job summary

AuraOne seeks an Executive Assistant / Admin operations reviewer to assess AI outputs in real-world workflows. You will apply multi-page rubric judgments and document policy-aligned next steps for model training. Remote US-eligible, this contractor role requires strong attention to detail and async availability of at least 10 hours weekly.

The work focuses on evaluating tone, escalation, and stakeholder fit while flagging risks and ensuring policy adherence across senior administrative processes.

Qualifications

• Direct working experience in executive assistant / admin specialist operations on real teams.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the policy or workflow being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current executive assistant / admin specialist operations workflows, playbooks, and firm policy for Executive Assistant / Admin assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed treatments against published playbooks or firm guidance.
• Maintain reviewer-quality scores in inter-rater calibration cycles.

Skills

Operational review

Policy adherence

Workflow judgment

Stakeholder communication

Executive assistant ops

Job description

AuraOne seeks an Executive Assistant / Admin operations reviewer to assess AI outputs in real-world workflows. You will apply multi-page rubric judgments and document policy-aligned next steps for model training. Remote US-eligible, this contractor role requires strong attention to detail and async availability of at least 10 hours weekly.

The work focuses on evaluating tone, escalation, and stakeholder fit while flagging risks and ensuring policy adherence across senior administrative processes.