Remote AI Writing QA Evaluator

AI Trainer Jobs; United States; Remote; USD 103,000 - 145,000; Full time

Job summary

AI Trainer Jobs is seeking a reviewer for Writers and Authors to evaluate AI outputs across domain writing workflows. You will grade tone, policy adherence, and stakeholder fit, flag risks, and document the right next step so the modeling team can train on it.

Experience in domain writing, applying long-form rubrics, and clear written reasoning are essential. The role requires reliable asynchronous availability for at least 10 hours per week, with a remote-US eligible contractor setup.

Qualifications

• Direct working experience in domain writing on real teams.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning that names the policy or workflow being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current domain writing workflows, playbooks, and firm policy for Writers and Authors assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed treatments against published playbooks or firm guidance.

Skills

Domain writing

Policy interpretation

Quality review

Attention to detail

Written reasoning

Tools

AI-assisted tooling

Job description

AI Trainer Jobs is seeking a reviewer for Writers and Authors to evaluate AI outputs across domain writing workflows. You will grade tone, policy adherence, and stakeholder fit, flag risks, and document the right next step so the modeling team can train on it.

Experience in domain writing, applying long-form rubrics, and clear written reasoning are essential. The role requires reliable asynchronous availability for at least 10 hours per week, with a remote-US eligible contractor setup.