Remote SOP & Process-Improvement Evaluator

AI Trainer Jobs; United States; Remote; USD 110,000 - 165,000; Full time

Job summary

AI Trainer Jobs is seeking a remote contractor to evaluate process improvement / SOP prompts and responses against AuraOne's quality rubric. You will compare paired outputs, label edge cases, and write structured feedback the modeling team can use to retrain.

As an AI data reviewer, you will help convert outputs into auditable labels, rationales, and regression cases for AuraOne Human Data, review frontier model outputs, and calibrate other reviewers.

Qualifications

• Experience evaluating prompts using a rubric and providing structured feedback.
• Ability to label edge cases and document rationale clearly.
• Strong attention to detail and written reasoning.

Responsibilities

• Evaluate process improvement / sops evaluation model outputs against rubric.
• Compare paired responses and select the stronger with rationale.
• Tag hallucinations, instruction-following failures, and unsafe content with structured tags.
• Collate findings and provide actionable feedback to retrain models.

Skills

Inter-rater calibration

Linguistics background

Content moderation

Trust & Safety review

Annotation experience

Job description

AI Trainer Jobs is seeking a remote contractor to evaluate process improvement / SOP prompts and responses against AuraOne's quality rubric. You will compare paired outputs, label edge cases, and write structured feedback the modeling team can use to retrain.

As an AI data reviewer, you will help convert outputs into auditable labels, rationales, and regression cases for AuraOne Human Data, review frontier model outputs, and calibrate other reviewers.