Remote AI Evaluator - Supply Chain & Logistics

AI Trainer Jobs; United States; Remote; USD 34,000 - 62,000; Part time

Job summary

AuraOne is seeking a remote Supply Chain and Logistics AI Evaluator to review evaluation prompts and responses against a quality rubric. You will compare paired outputs, label edge cases, and create structured feedback for retraining the model team.

Role focuses on tagging model outputs, identifying issues, and contributing to calibration cycles while working as an independent contractor on an hourly basis.

Qualifications

• Prior evaluation, annotation, or human-rater experience in AI evaluation for supply chain and logistics.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning that names issues and rubric clauses.

Responsibilities

• Evaluate AI evaluation outputs against versioned rubric and assign severity tags.
• Compare paired responses and select the stronger with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route to program team for rubric updates.

Skills

Attention to detail

Critical thinking

Written reasoning

Multi-page rubric application

Independent scheduling

English proficiency

Job description

AuraOne is seeking a remote Supply Chain and Logistics AI Evaluator to review evaluation prompts and responses against a quality rubric. You will compare paired outputs, label edge cases, and create structured feedback for retraining the model team.

Role focuses on tagging model outputs, identifying issues, and contributing to calibration cycles while working as an independent contractor on an hourly basis.