Remote Accent Robustness Evaluator - Contract, Hourly

AI Trainer Jobs; United States; Remote; USD 28,000 - 55,000; Part time

Benefits offered by this job

Remote work

Job summary

AuraOne seeks an Accent Robustness Conversation Evaluator to remotely review prompts and responses, label edge cases, and provide structured feedback for retraining. You will compare paired outputs, judge quality against a rubric, and help turn results into auditable labels and regression cases.

The role is remote (US-eligible) as a contractor with hourly compensation; placement depends on program demand and reviewer confirmation.

Qualifications

• Prior evaluation, annotation, or human-rater experience in accent robustness or related content review.
• Ability to apply rubrics consistently across long batches.
• Clear written reasoning naming the issue and rubric clause being applied.

Responsibilities

• Evaluate model outputs against a versioned rubric and label severity.
• Compare paired responses and select the stronger answer with rationale.
• Tag hallucinations, policy violations, and unsafe content with structured labels.
• Identify ambiguous prompts and route for rubric updates.

Skills

Evaluation experience

Annotation

Inter-rater calibration

Attention to detail

Job description

AuraOne seeks an Accent Robustness Conversation Evaluator to remotely review prompts and responses, label edge cases, and provide structured feedback for retraining. You will compare paired outputs, judge quality against a rubric, and help turn results into auditable labels and regression cases.

The role is remote (US-eligible) as a contractor with hourly compensation; placement depends on program demand and reviewer confirmation.