Remote AI Systems QA Analyst

AI Trainer Jobs; United States; Remote; USD 83,000 - 165,000; Full time

Job summary

AuraOne is seeking a Computer Systems Analyst to remotely review AI outputs across specialist operations. You will evaluate workflow correctness, policy adherence, and stakeholder fit, flag risks, and document next steps to train the modeling team.

This contractor role requires experience with operations teams, attention to detail, and the ability to apply structured rubrics to long batches, with at least 10 hours per week available.

Qualifications

• Direct working experience in computer systems analyst specialist operations on real teams.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning that names the policy or workflow being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current computer systems analyst specialist operations workflows, playbooks, and firm policy for Computer Systems Analyst assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.

Job description

AuraOne is seeking a Computer Systems Analyst to remotely review AI outputs across specialist operations. You will evaluate workflow correctness, policy adherence, and stakeholder fit, flag risks, and document next steps to train the modeling team.

This contractor role requires experience with operations teams, attention to detail, and the ability to apply structured rubrics to long batches, with at least 10 hours per week available.