Remote Journalism Evaluation & Policy QA Specialist

AI Trainer Jobs; United States; Remote; USD 96,000 - 138,000; Full time

Job summary

AI Trainer Jobs is seeking a Journalism Evaluation Specialist for a remote reviewer role. You will evaluate AI outputs within journalism operations workflows, grade tone and escalation logic, and flag policy-adherence gaps to guide training data for the modeling team.

The position is a remote contractor with hourly compensation and eligibility for US-based workers. You will assess workflow correctness and stakeholder fit, documenting the right next steps for improvement.

Qualifications

• Direct working experience in journalism evaluation specialist operations on real teams for Journalism Evaluation Specialist work.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the policy or workflow being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current journalism evaluation specialist operations workflows, playbooks, and firm policy for Journalism Evaluation Specialist assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.

Job description

AI Trainer Jobs is seeking a Journalism Evaluation Specialist for a remote reviewer role. You will evaluate AI outputs within journalism operations workflows, grade tone and escalation logic, and flag policy-adherence gaps to guide training data for the modeling team.

The position is a remote contractor with hourly compensation and eligibility for US-based workers. You will assess workflow correctness and stakeholder fit, documenting the right next steps for improvement.