Remote Revenue Recognition AI Evaluator

AuraOne, Inc.; United States; A distancia; USD 28.000 - 55.000; Jornada completa

Descripción de la vacante

AuraOne, Inc. seeks a Revenue Recognition AI Reviewer to remotely assess evaluation prompts and responses against a published quality rubric. You will compare paired outputs, label edge cases, and produce structured feedback to retrain the model.

As a contractor, you’ll contribute asynchronously with at least 10 hours per week and must be authorized to work in the US. This role emphasizes attention to detail, clear rationale, and consistency across multi-page rubrics.

Formación

• Prior evaluation, annotation, or human-rater experience on revenue recognition AI evaluation or adjacent content for Revenue Recognition AI Reviewer work.
• Clear written reasoning that names the issue and the rubric clause being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.

Responsabilidades

• Evaluate revenue recognition AI evaluation model outputs against a versioned rubric and assign severity tags for Revenue Recognition AI Reviewer assignments.
• Compare paired responses and pick the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them back to the program team for rubric updates.
• Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
• Document recurring failure modes so the modeling team can target them in the next training run.

Conocimientos

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

Revenue Recognition AI evaluation

Financial analysis

Audit review

Risk reasoning

Revenue

Recognition

Descripción del empleo

AuraOne, Inc. seeks a Revenue Recognition AI Reviewer to remotely assess evaluation prompts and responses against a published quality rubric. You will compare paired outputs, label edge cases, and produce structured feedback to retrain the model.

As a contractor, you’ll contribute asynchronously with at least 10 hours per week and must be authorized to work in the US. This role emphasizes attention to detail, clear rationale, and consistency across multi-page rubrics.