Remote Spanish Dialect Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 34,000 - 55,000; Full time

Job summary

AI Trainer Jobs is seeking a Spanish Dialect Cultural Context Reviewer for remote evaluation work. You will review Spanish- language prompts and responses against a quality rubric, compare outputs, and provide structured feedback to help retrain the model.

The role emphasizes careful annotation, rubric-aligned reasoning, and consistent performance across batches. This is a contract-based, remote position with US eligibility and hourly compensation after interview.

Qualifications

• Background in linguistics, content moderation, or trust & safety review.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning naming the issue and rubric clause.
• Strong attention to detail and ability to flag prompt problems.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate Spanish generalist evaluation model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them to the program team for rubric updates.

Skills

Linguistics

Content moderation

Trust & safety

Inter-rater calibration

Spanish evaluation

Job description

AI Trainer Jobs is seeking a Spanish Dialect Cultural Context Reviewer for remote evaluation work. You will review Spanish- language prompts and responses against a quality rubric, compare outputs, and provide structured feedback to help retrain the model.

The role emphasizes careful annotation, rubric-aligned reasoning, and consistent performance across batches. This is a contract-based, remote position with US eligibility and hourly compensation after interview.