Remote Senior System Administrator AI QA Reviewer

AI Trainer Jobs; United States; Remote; USD 83,000 - 138,000; Full time

Job summary

AI Trainer Jobs seeks a System Administrator Expert to remotely review AI outputs across system administrator operations. You will evaluate workflow correctness, policy adherence, and stakeholder fit, and document the right next step so the modeling team can train on it.

The role emphasizes structured rubric-based scoring, flagging operational risk, and clear written reasoning. You should have direct experience in system administrator operations and be available at least 10 hours per week.

Qualifications

• Direct working experience in system administrator operations on real teams for System Administrator Expert work.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning naming the policy/workflow applied.
• Strong attention to detail and ability to flag prompts when the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current system administrator specialist operations workflows, playbooks, and firm policy for System Administrator Expert assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.

Skills

System administration

Policy adherence

Workflow judgment

Attention to detail

Async availability

Bilingual (cross-region)

Tools

AI-assisted tooling

Rubrics

Job description

AI Trainer Jobs seeks a System Administrator Expert to remotely review AI outputs across system administrator operations. You will evaluate workflow correctness, policy adherence, and stakeholder fit, and document the right next step so the modeling team can train on it.

The role emphasizes structured rubric-based scoring, flagging operational risk, and clear written reasoning. You should have direct experience in system administrator operations and be available at least 10 hours per week.