Remote Compliance AI Evaluator and Risk Auditor

AI Trainer Jobs; United States; Remote; USD 55,000 - 83,000; Full time

Job summary

AI Trainer Jobs seeks a Compliance Workflow Agent Evaluator to remotely review AI outputs in compliance workflows. You will assess citations, statutory reasoning, and policy adherence; flag risks; and document the corrected analysis so the modeling team can train on it.

This contractor role is remote, US-eligible, pays $50 per hour, and requires reliable async availability for at least 10 hours per week with program-defined task pacing.

Qualifications

• Active or recent qualification in compliance or an adjacent practice.
• Hands-on experience drafting, reviewing, or advising on real matters.
• Clear written reasoning that cites authority and names the rule being applied.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current compliance statutes, case law, or policy for Compliance Workflow Agent Evaluator assignments.
• Verify citations, jurisdictions, and dates against authoritative sources.
• Flag risky reasoning, missed exceptions, and policy-adherence gaps with severity tags.
• Capture the corrected analysis or memo paragraph so the modeling team can train on it.
• Adjudicate disputed treatments against published authority or firm policy.
• Audit a 25-row batch for rubric consistency and report drift to the program lead.

Skills

Legal research

Citation review

Statutory analysis

Policy reasoning

Compliance

Workflow evaluation

Tool-use review

Operational judgment

Workflow

Education

Bar admission or legal-equivalent credential in a relevant jurisdiction

Job description

AI Trainer Jobs seeks a Compliance Workflow Agent Evaluator to remotely review AI outputs in compliance workflows. You will assess citations, statutory reasoning, and policy adherence; flag risks; and document the corrected analysis so the modeling team can train on it.

This contractor role is remote, US-eligible, pays $50 per hour, and requires reliable async availability for at least 10 hours per week with program-defined task pacing.