Accounting AI Task Designer & Rubric Specialist

Huzzle; United States; Remote; USD 70,000 - 120,000; Full time

Job summary

Huzzle Labs is seeking experienced accountants to write realistic accounting tasks that test how frontier AI systems handle accounting work. You will create prompts that are difficult for frontier models to fail, then write scoring rubrics for each task.

Training is provided and prior AI training or data-annotation experience is required. You will review a deal room of files to extract material, produce deliverables such as spreadsheets or journal-entry memos, test outputs against models, and

Qualifications

• Must have accounting expertise.
• Prior AI training or data-annotation experience is required.
• Training is provided.

Responsibilities

• Write realistic accounting tasks: Create requests of the kind a client, controller or business owner would send, covering month-end close, bank and credit card reconciliations, AR/AP ageing, accruals and adjusting entries, sales tax, job costing and the clean-up of incomplete or inconsistent books.
• Build from real material: Review a deal room containing hundreds of files, select the relevant documents and use them to develop prompts and rubrics for tasks a frontier model struggles to complete correctly.
• Require usable deliverables: Each request should call for a working output, usually a spreadsheet, a journal entry schedule or a short memo.
• Test against a frontier model: Run each request and review the output with the care you would apply when signing off accounting work.
• Where the model succeeds, increase the difficulty until a genuine gap appears.
• Write scoring rubrics: Define objective criteria that another reviewer can apply without repeati

Skills

Accounting expertise

Job description

Huzzle Labs is seeking experienced accountants to write realistic accounting tasks that test how frontier AI systems handle accounting work. You will create prompts that are difficult for frontier models to fail, then write scoring rubrics for each task.

Training is provided and prior AI training or data-annotation experience is required. You will review a deal room of files to extract material, produce deliverables such as spreadsheets or journal-entry memos, test outputs against models, and