Remote Spanish Language Evaluator (Spain) - Model Eval

AI Trainer Jobs; United States; Remote; USD 28,000 - 55,000; Full time

Benefits offered by this job

Remote work

Job summary

AuraOne seeks a Spanish Language Expert (Spain) to remotely evaluate generalist prompts and responses, applying a versioned rubric and producing structured feedback for retraining. You will review pairings, label edge cases, and document your rationale for program improvement.

Ideal candidates bring prior Spanish evaluation experience, strong written reasoning, and reliable part-time availability (about 10 hours weekly) as an independent contractor.

Qualifications

• Prior evaluation, annotation, or human-rater experience on spanish generalist evaluation or adjacent content for Spanish Language Expert (Spain) work.
• Clear written reasoning that names the issue and the rubric clause being applied.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate spanish generalist evaluation model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and pick the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them back to the program team for rubric updates.
• Maintain reviewer-quality scores by calibrating against gold-standard examples each week.

Skills

Evaluation experience

Annotation experience

Spanish language

Attention to detail

Written reasoning

Async availability

Job description

AuraOne seeks a Spanish Language Expert (Spain) to remotely evaluate generalist prompts and responses, applying a versioned rubric and producing structured feedback for retraining. You will review pairings, label edge cases, and document your rationale for program improvement.

Ideal candidates bring prior Spanish evaluation experience, strong written reasoning, and reliable part-time availability (about 10 hours weekly) as an independent contractor.