Audit and Controls AI Evaluator

AI Trainer Jobs; United States; Remote; USD 55,000 - 83,000; Part time

Job summary

AI Trainer Jobs seeks an Audit and Controls AI Evaluator to remotely review AI outputs in audit workflows. You will re-perform calculations, flag issues, and document corrected workpapers to train the modeling team.

Candidates bring direct audit experience, credentials such as CPA/CFA/ACA, and the ability to apply multi-page rubrics consistently across long batches. This contractor role offers hourly pay and async availability.

Qualifications

• Direct working experience with audit on real engagements, transactions, or audits.
• CPA, CFA, or ACA; comparable credentials accepted.
• Ability to apply multi-page rubrics consistently across large batches.
• Clear written reasoning citing standards, regulations, or firm policy.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current audit standards, regulations, and firm policy for Audit and Controls AI Evaluator assignments.
• Re-perform calculations and flag rounding, classification, or treatment errors.
• Tag compliance, reconciliation, and disclosure issues with structured severity scores.
• Capture the corrected workpaper or narrative so the modeling team can train on it.
• Adjudicate disputed treatments against published standards or firm guidance.
• Audit a batch for rubric consistency and report drift to the program lead.

Skills

Audit experience

Regulatory standards

Financial analysis

Risk assessment

AI evaluation

Rubric writing

Expert review

Bilingual experience

Education

CPA

CFA

ACA

Job description

About the role

Audit and Controls AI Evaluator is a remote review track for evaluating AI outputs across audit workflows. Reviewers grade calculations, narrative reasoning, and policy adherence; flag compliance and reconciliation issues; and document the correct treatment so the modeling team can train on it.
Audit workflows leave no room for fuzzy reasoning. AuraOne uses experienced finance-and-risk professionals to grade AI outputs the way an audit reviewer would — with citations, severity tags, and the corrected calculation alongside the original.
Review financial reasoning and accounting treatment. Audit logic and risk work too.

Responsibilities

• Review AI outputs against current audit standards, regulations, and firm policy for Audit and Controls AI Evaluator assignments.
• Re-perform calculations and flag rounding, classification, or treatment errors.
• Tag compliance, reconciliation, and disclosure issues with structured severity scores.
• Capture the corrected workpaper or narrative so the modeling team can train on it.
• Adjudicate disputed treatments against published standards or firm guidance.
  Track Finance & risk review Work model Remote Independent specialist contractor Compensation Hourly rate confirmed after the interview process. Eligible from US

What you should bring

• Direct working experience with audit on real engagements, transactions, or audits for Audit and Controls AI Evaluator work.
• A CPA, CFA, or ACA. A comparable credential or equivalent applied experience also works.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that cites standards, regulations, or firm policy.
• Reliable async availability for at least 10 hours per week.

Role signals

Example tasks

• Re-perform a audit calculation produced by a model and flag any rounding or classification errors.
• Grade a model's narrative reasoning on a complex transaction and rate the citation quality.
• Adjudicate a disputed treatment between two reviewers using current standards.
• Audit a 25-row batch for rubric consistency and report drift to the program lead.

Useful experience

• Big Four, bulge-bracket, or in-house controller / risk experience.
• Familiarity with AI-assisted close, audit, or risk tooling and its failure modes.
• Bilingual experience for cross-jurisdiction reviews.

Compensation and schedule

Hourly rate confirmed after the interview process.
Expected arrangement: contractor , with program-defined task volume and review pacing. Placement depends on current program demand and reviewer confirmation.

Skills used in matching

• Financial analysis
• Audit-grade review
• Regulatory standards
• Risk assessment
• Audit
• Quantitative finance and economics
• AI evaluation
• Rubric writing
• Expert review

Application boundary

Creating a specialist profile records your experience and preferences. Starting role intake is a separate action that attaches this role to your candidate record.

Specialist intake

The intake preserves your chosen role, the visible terms, and source attribution for reviewer context.

• 01 Confirm profile and eligibility details.
• 02 Attach this role deliberately.
• 03 Receive a human review decision or follow-up.
  Placement timing depends on program demand and reviewer confirmation.