Remote MCP Operations QA Reviewer for AI Outputs

AI Trainer Jobs; United States; Remote; USD 96,000 - 138,000; Part time

Job summary

AuraOne is seeking an MCP Expert to remotely review AI outputs across mcp specialist operations workflows. You will grade workflow correctness, policy adherence, and stakeholder fit, flag operational risk, and document the next steps for training.

You will work with experienced operators to judge tool-use tasks and enterprise agent behavior, providing clear written reasoning. This contractor role requires ~10 hours/week with an hourly rate determined after interview.

Qualifications

• Direct working experience in mcp specialist operations on real teams.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the policy or workflow being applied.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current mcp specialist operations workflows, playbooks, and firm policy for MCP Expert assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed treatments against published playbooks or firm guidance.

Skills

Attention to detail

Analytical thinking

Written reasoning

Async availability

Bilingual experience

Tools

AI workflow tooling

Rubrics

Job description

AuraOne is seeking an MCP Expert to remotely review AI outputs across mcp specialist operations workflows. You will grade workflow correctness, policy adherence, and stakeholder fit, flag operational risk, and document the next steps for training.

You will work with experienced operators to judge tool-use tasks and enterprise agent behavior, providing clear written reasoning. This contractor role requires ~10 hours/week with an hourly rate determined after interview.