ML Challenge Task Auditor

AI Trainer Jobs; United States; Remote; USD 96,000 - 124,000; Full time

Job summary

AuraOne seeks a Remote ML Challenge Task Auditor to review AI outputs across audit workflows. You will re-perform calculations, assess narrative reasoning, and verify compliance with standards and policy, flagging inaccuracies and documenting corrected treatments for training data.

As a contractor, you’ll collaborate with experienced finance and risk professionals, provide citations and severity tags, and ensure audit-grade diligence across multi-page rubrics.

Qualifications

• Direct working experience with audit on real engagements, transactions, or audits for ML Challenge Task Auditor work.
• Clear written reasoning that cites standards, regulations, or firm policy.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current audit standards, regulations, and firm policy.
• Re-perform calculations and flag rounding, classification, or treatment errors.
• Tag compliance, reconciliation, and disclosure issues with structured severity scores.
• Capture the corrected workpaper or narrative so the modeling team can train on it.
• Adjudicate disputed treatments against published standards or firm guidance.

Skills

Financial analysis

Audit-grade review

Regulatory standards

Risk assessment

Education

CPA

CFA

ACA

Job description

ML Challenge Task Auditor is a remote review track for evaluating AI outputs across audit workflows. Reviewers grade calculations, narrative reasoning, and policy adherence; flag compliance and reconciliation issues; and document the correct treatment so the modeling team can train on it.

Category: Finance, Accounting & Economic AI · Pay: $70–$90 / hr · Location: Remote — US-eligible · Contractor

ML Challenge Task Auditor is a remote review track for evaluating AI outputs across audit workflows.

About the role

ML Challenge Task Auditor is a remote review track for evaluating AI outputs across audit workflows. Reviewers grade calculations, narrative reasoning, and policy adherence; flag compliance and reconciliation issues; and document the correct treatment so the modeling team can train on it.
Audit workflows leave no room for fuzzy reasoning. AuraOne uses experienced finance-and-risk professionals to grade AI outputs the way an audit reviewer would — with citations, severity tags, and the corrected calculation alongside the original.
Review financial reasoning and accounting treatment. Audit logic and risk work too.

Responsibilities

• Review AI outputs against current audit standards, regulations, and firm policy for ML Challenge Task Auditor assignments.
• Re-perform calculations and flag rounding, classification, or treatment errors.
• Tag compliance, reconciliation, and disclosure issues with structured severity scores.
• Capture the corrected workpaper or narrative so the modeling team can train on it.
• Adjudicate disputed treatments against published standards or firm guidance.

What you should bring

• Direct working experience with audit on real engagements, transactions, or audits for ML Challenge Task Auditor work.
• A CPA, CFA, or ACA. A comparable credential or equivalent applied experience also works.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that cites standards, regulations, or firm policy.
• Reliable async availability for at least 10 hours per week.

Example tasks

• Re-perform a audit calculation produced by a model and flag any rounding or classification errors.
• Grade a model's narrative reasoning on a complex transaction and rate the citation quality.
• Adjudicate a disputed treatment between two reviewers using current standards.
• Audit a 25-row batch for rubric consistency and report drift to the program lead.

Useful experience

• Big Four, bulge-bracket, or in-house controller / risk experience.
• Familiarity with AI-assisted close, audit, or risk tooling and its failure modes.
• Bilingual experience for cross-jurisdiction reviews.

Compensation and schedule

$70–$90 / hr
Expected arrangement: contractor , with program-defined task volume and review pacing. Placement depends on current program demand and reviewer confirmation.

Skills used in matching

• Financial analysis
• Audit-grade review
• Regulatory standards
• Risk assessment
• Audit
• Basic Qualifications