Senior Internal Auditor - AI Trainer

AfterQuery Experts; Denver (CO); Remote; USD 91,000 - 129,000; Part time

Benefits offered by this job

Weekly pay

Fully remote

Job summary

AfterQuery Experts is seeking senior internal auditors as contractors to author and grade SOX and IT-audit reasoning used in evaluating frontier AI models. You will create end-to-end audit scenarios, draft reference answers, and assess model outputs for control soundness and defensibility.

You should bring 5+ years in internal audit, SOX compliance, or IT audit, with hands-on experience testing ITGCs, application controls, or key financial controls.

Qualifications

• 5+ years in internal audit, SOX compliance, or IT audit.
• Hands-on experience scoping and testing ITGCs, application controls, or key financial controls.
• CIA, CISA, CPA or equivalent is a plus, not a requirement.

Responsibilities

• Author end-to-end internal-audit scenarios: risk assessment, control design, testing approach, and conclusion.
• Write reference answers showing the control logic and evidence behind each judgment.
• Grade model output for control-testing soundness and defensibility of conclusions.
• Flag walkthroughs that may read plausibly but wouldn’t pass external audit or regulator scrutiny.

Skills

Internal audit

SOX compliance

IT audit

Risk assessment

Audit scoring

Education

CIA preferred

CISA or CPA preferred

Job description

AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We are hiring senior internal auditors as contractors to author and grade the SOX and IT-audit reasoning those evaluations run on.

What You Will Actually Do

• Author realistic internal-audit scenarios end to end: risk assessment, control design, testing approach, and conclusion
• Write reference answers that show the control logic and evidence behind each judgment
• Grade model output for control-testing soundness and defensibility of conclusions
• Flag walkthroughs that read plausibly but would not survive an external auditor or a regulator

Who This Is For

• 5+ years in internal audit, SOX compliance, or IT audit
• Hands‑on experience scoping and testing ITGCs, application controls, or key financial controls
• CIA, CISA, CPA or equivalent is a plus, not a requirement
• You have personally executed audits, not only reviewed them

Contract and pay

• $80/hour, paid weekly
• Fully remote and asynchronous, on your own schedule
• Contract engagement, no sponsorship available