Remote Spanish Evaluation & Feedback Specialist

AI Trainer Jobs; United States; Remote; USD 83,000 - 96,000; Full time

Job summary

AuraOne is seeking remote reviewers to evaluate Spanish generalist prompts and responses against its quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback for retraining.

As a reviewer, you will label hallucinations and safety issues, route ambiguous prompts to the program team, and calibrate scores against gold-standard examples each week. The role is about 10 hours weekly as a contractor with pay of $60–$70 per hour.

Qualifications

• Prior evaluation, annotation, or human-rater experience on Spanish content.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning naming the issue and rubric clause.

Responsibilities

• Evaluate spanish generalist evaluation model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with a rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them to the program team for rubric updates.
• Calibrate reviewer-quality scores against gold-standard examples weekly.

Skills

Evaluation experience

Spanish proficiency

Attention to detail

Async availability

Job description

AuraOne is seeking remote reviewers to evaluate Spanish generalist prompts and responses against its quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback for retraining.

As a reviewer, you will label hallucinations and safety issues, route ambiguous prompts to the program team, and calibrate scores against gold-standard examples each week. The role is about 10 hours weekly as a contractor with pay of $60–$70 per hour.