Remote Microsoft 365 AI QA & Policy Reviewer

AuraOne; United States; Remote; USD 41,000 - 83,000; Part time

Benefits offered by this job

Remote work

Contractor role

Flexible hours

Job summary

AI Trainer Jobs is seeking a Microsoft 365 Specialist reviewer to evaluate AI outputs across MS365 operations workflows. This remote contractor role focuses on grading workflow correctness, policy adherence, and stakeholder fit, and on reporting next steps to the modeling team.

You will work asynchronously for at least 10 hours weekly, with pay arranged after interviews. Experience on real MS365 ops teams, ability to apply multi-page rubrics, and clear written reasoning are essential.

Qualifications

• Direct experience in Microsoft 365 operations on real teams.
• Capable of applying long, multi-page rubrics consistently.
• Provide explicit written reasoning naming the policy/workflow applied.
• Excellent attention to detail and ability to flag prompt issues.
• Available asynchronously for at least 10 hours per week.

Responsibilities

• Review AI outputs against MS365 workflows, playbooks, and policy.
• Grade tone, escalation logic, and stakeholder fit.
• Flag operational risk and policy-adherence gaps with severity tags.
• Capture the right next steps for model training.
• Adjudicate disputed playbook calls using firm guidance.

Skills

MS 365 ops

Rubric application

Clear written reasoning

Attention to detail

Async availability

Tools

AI tooling

Job description

AI Trainer Jobs is seeking a Microsoft 365 Specialist reviewer to evaluate AI outputs across MS365 operations workflows. This remote contractor role focuses on grading workflow correctness, policy adherence, and stakeholder fit, and on reporting next steps to the modeling team.

You will work asynchronously for at least 10 hours weekly, with pay arranged after interviews. Experience on real MS365 ops teams, ability to apply multi-page rubrics, and clear written reasoning are essential.