Remote Spreadsheet QA Evaluator for Model Feedback

AI Trainer Jobs; United States; Remote; USD 110,000 - 165,000; Full time

Benefits offered by this job

Remote work

Job summary

AI Trainer Jobs is seeking a remote Spreadsheet QA / workbook maintenance Evaluator to review prompts and responses against AuraOne's rubric. You will help turn outputs into auditable labels, rationales, and regression cases for the human data program.

The role involves evaluating model outputs, tagging issues, and providing structured feedback. This is a contractor, remote position with US eligibility, and compensation ranges from $80–$120 per hour.

Qualifications

• Experience evaluating spreadsheet QA / workbook maintenance prompts and outputs.
• Ability to apply rubrics to judge quality and edge cases.
• Clear written reasoning naming issues and rubric clauses.

Responsibilities

• Evaluate model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with tags.
• Capture ambiguous prompts and route them for rubric updates.

Skills

Spreadsheet QA

Annotation

Human rater

Inter-rater calibration

Attention to detail

Rubric-based evaluation

Job description

AI Trainer Jobs is seeking a remote Spreadsheet QA / workbook maintenance Evaluator to review prompts and responses against AuraOne's rubric. You will help turn outputs into auditable labels, rationales, and regression cases for the human data program.

The role involves evaluating model outputs, tagging issues, and providing structured feedback. This is a contractor, remote position with US eligibility, and compensation ranges from $80–$120 per hour.