Remote Revenue Recognition Evaluator (Model Evaluation)

AI Trainer Jobs; United States; Remote; USD 34,000 - 55,000; Part time

Job summary

AuraOne is seeking a Revenue Recognition Reasoning Evaluator to remotely review evaluation prompts and responses, compare paired outputs, and provide structured feedback for retraining. You will judge outputs against a quality rubric and label edge cases with precise reasoning.

Role is a remote contractor position with flexible hours and hourly compensation. Candidates should have prior evaluation or annotation experience and strong attention to detail for multi-page rubrics.

Qualifications

• Experience evaluating model outputs against rubrics.
• Ability to label edge cases and provide structured feedback.
• Clear written reasoning naming issues and rubric clauses.
• Strong attention to detail and calibration across batches.

Responsibilities

• Evaluate model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger one with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with tags.
• Capture ambiguous prompts and suggest rubric updates to the program team.

Skills

Evaluation experience

Rubric application

Written reasoning

Attention to detail

Async availability

Job description

AuraOne is seeking a Revenue Recognition Reasoning Evaluator to remotely review evaluation prompts and responses, compare paired outputs, and provide structured feedback for retraining. You will judge outputs against a quality rubric and label edge cases with precise reasoning.

Role is a remote contractor position with flexible hours and hourly compensation. Candidates should have prior evaluation or annotation experience and strong attention to detail for multi-page rubrics.