Remote Data Analyst QA & AI Workflow Auditor

AI Trainer Jobs; United States; Remote; USD 96,000 - 138,000; Full time

Job summary

AI Trainer Jobs is seeking a Data Analyst to join a remote review team evaluating AI outputs within data analyst operations. You will assess workflow correctness, policy adherence, and stakeholder fit, and document next steps to help train the modeling team.

As a contractor, you will work with established playbooks, applying rubrics across batches and providing clear reasoning about the policies used. The role requires about 10 hours per week with asynchronous availability.

Qualifications

• Direct working experience in data analyst specialist operations on real teams for Data Analyst work.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the policy or workflow being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current data analyst specialist operations workflows, playbooks, and firm policy for Data Analyst assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed treatments against published playbooks or firm guidance.

Skills

Operational review

Policy adherence

Workflow judgment

Stakeholder communication

Data Analyst specialist operations

Job description

AI Trainer Jobs is seeking a Data Analyst to join a remote review team evaluating AI outputs within data analyst operations. You will assess workflow correctness, policy adherence, and stakeholder fit, and document next steps to help train the modeling team.

As a contractor, you will work with established playbooks, applying rubrics across batches and providing clear reasoning about the policies used. The role requires about 10 hours per week with asynchronous availability.