Remote Bilingual Spanish AI Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 34,000 - 55,000; Part time

Job summary

AI Trainer Jobs is seeking a Bilingual Spanish AI Evaluation Specialist to work remotely as an independent contractor. You will review Spanish generalist prompts and responses against AuraOne's rubric, compare outputs, label edge cases, and draft structured feedback for retraining the model.

The role emphasizes consistent rubric application, clear reasoning, and reliable part-time availability (around 10 hours weekly).

Qualifications

• Prior evaluation, annotation, or human-rater experience with rubrics.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written rationale that names the issue and rubric clause being applied.

Responsibilities

• Evaluate Spanish generalist evaluation model outputs against a rubric and assign severity tags for Bilingual Spanish AI Evaluation Specialist assignments.
• Compare paired responses and pick the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them back to the program team for rubric updates.
• Maintain reviewer-quality scores by calibrating against gold-standard examples each week.

Skills

Spanish evaluation

Attention to detail

Rubric reasoning

Evaluation experience

Job description

AI Trainer Jobs is seeking a Bilingual Spanish AI Evaluation Specialist to work remotely as an independent contractor. You will review Spanish generalist prompts and responses against AuraOne's rubric, compare outputs, label edge cases, and draft structured feedback for retraining the model.

The role emphasizes consistent rubric application, clear reasoning, and reliable part-time availability (around 10 hours weekly).