Remote AI QA Specialist — Plumbers Operations

AI Trainer Jobs; United States; Remote; USD 28,000 - 41,000; Full time

Job summary

Plumbers is a remote review track for evaluating AI outputs across plumbers specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train on it.

AuraOne uses experienced operators to grade outputs the way a senior peer would — checking workflow, policy, and the unwritten rules that decide whether a task actually gets done.

Qualifications

• Direct working experience in plumbers specialist operations on real teams for Plumbers work.
• Clear written reasoning naming the policy or workflow being applied.
• Strong attention to detail and ability to flag when a prompt itself is the problem.

Responsibilities

• Review AI outputs against current plumbers specialist operations workflows, playbooks, and firm policy for Plumbers assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed treatments against published playbooks or firm guidance.

Skills

Operational review

Policy adherence

Workflow judgment

Stakeholder communication

Plumbers specialist operations

Attention to detail

Job description

Plumbers is a remote review track for evaluating AI outputs across plumbers specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train on it.

AuraOne uses experienced operators to grade outputs the way a senior peer would — checking workflow, policy, and the unwritten rules that decide whether a task actually gets done.