Remote IT Operations QA & AI Review Lead

AI Trainer Jobs; United States; Remote; USD 99,000 - 135,000; Full time

Job summary

AI Trainer Jobs is seeking an IT Operations Manager for a remote review track evaluating AI outputs across operations workflows. Reviewers grade workflow correctness, policy adherence, stakeholder fit, flag risk, and document next steps to train the modeling team.

The role is contractor, remote with US eligibility, paying $85 per hour. Responsibilities include reviewing outputs against playbooks and firm policy, rating tone and escalation, and providing actionable notes for model improvement.

Qualifications

• Direct working experience in IT Operations Manager roles on real teams.
• Comfort applying multi-page rubrics consistently.
• Clear written reasoning naming the policy or workflow.
• Strong attention to detail and ability to flag prompt issues.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against IT operations workflows, playbooks, and policy.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.

Skills

Direct experience

Rubric application

Policy reasoning

Attention to detail

Async availability

Job description

AI Trainer Jobs is seeking an IT Operations Manager for a remote review track evaluating AI outputs across operations workflows. Reviewers grade workflow correctness, policy adherence, stakeholder fit, flag risk, and document next steps to train the modeling team.

The role is contractor, remote with US eligibility, paying $85 per hour. Responsibilities include reviewing outputs against playbooks and firm policy, rating tone and escalation, and providing actionable notes for model improvement.