Remote Spanish AI Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 44,000 - 61,000; Full time

Job summary

AI Trainer Jobs is seeking a Bilingual Writer - Spanish (Spain) for a remote evaluation track. You will review Spanish prompts and responses against AuraOne's rubric, label edge cases, and provide structured feedback to retrain the model.

Responsibilities include evaluating model outputs, comparing paired responses, tagging issues, and highlighting ambiguities. Remote, US-eligible contractor role offering $38 per hour with flexibility for part-time engagement.

Qualifications

• Experience evaluating model outputs using rubrics or guidelines.
• Clear written reasoning naming the issue and rubric clause.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate Spanish generalist evaluation outputs against a rubric.
• Compare paired responses and select the stronger one with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with tags.
• Capture ambiguous prompts and escalate for rubric updates.
• Maintain reviewer-quality scores by calibration against gold-standard examples.

Skills

Spanish evaluation

Annotation

Inter-rater calibration

Content moderation

Job description

AI Trainer Jobs is seeking a Bilingual Writer - Spanish (Spain) for a remote evaluation track. You will review Spanish prompts and responses against AuraOne's rubric, label edge cases, and provide structured feedback to retrain the model.

Responsibilities include evaluating model outputs, comparing paired responses, tagging issues, and highlighting ambiguities. Remote, US-eligible contractor role offering $38 per hour with flexibility for part-time engagement.