AI Work-Product Auditor — Domain Expert Reviewer

Obsidian; Sydney; À distance; AUD 110 000 - 180 000; Plein temps

Résumé du poste

Obsidian is seeking working professional services practitioners to audit AI work product in their own field, not to produce it. You will review an AI agent's complete attempt at a realistic task, including the task, what the agent did, the files it produced, and the scoresheet an AI grader filled in afterwards.

You bring the judgment of someone who does this work for a living, and answer four questions: real vs contrived task, domain accuracy, grading validity, and defensibility.

Qualifications

• 5+ years running real project plans, schedules and budgets.
• Understanding of audit processes and quality controls.
• Experience drafting or reviewing professional documents.

Responsabilités

• Audit AI work product in one’s field, not to produce it.
• Review the AI agent’s complete task, attached files, and scoresheets.
• Provide judgments and answers to four key questions for each item.
• Assist in determining if the score is defensible and actionable.

Connaissances

Project management

Auditing

Legal drafting

Software development

IT management

Business English

Spreadsheet proficiency

Outils

Excel

Description du poste

Obsidian is seeking working professional services practitioners to audit AI work product in their own field, not to produce it. You will review an AI agent's complete attempt at a realistic task, including the task, what the agent did, the files it produced, and the scoresheet an AI grader filled in afterwards.

You bring the judgment of someone who does this work for a living, and answer four questions: real vs contrived task, domain accuracy, grading validity, and defensibility.