Remote Spanish Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 34,000 - 55,000; Full time

Benefits offered by this job

Remote work

Contractor engagement

US-eligible

Job summary

AuraOne is seeking a Spanish Language Expert to remotely review Spanish prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and draft structured feedback for retraining. This is a contractor role with hourly pay to be confirmed after the interview.

You will work asynchronously for at least 10 hours per week, across multi-page rubrics. Ideal candidates have evaluation or annotation experience with Spanish language content and a keen eye for detail,

Qualifications

• Prior evaluation, annotation, or human-rater experience on Spanish generalist evaluation or adjacent content.
• Ability to apply multi-page rubrics consistently across large batches.
• Clear written reasoning naming the issue and rubric clause being applied.

Responsibilities

• Evaluate Spanish generalist outputs against a rubric and assign severity tags for Spanish Language Expert assignments.
• Compare paired responses and select the stronger with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route to rubric updates.

Skills

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

Spanish generalist evaluation

Job description

AuraOne is seeking a Spanish Language Expert to remotely review Spanish prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and draft structured feedback for retraining. This is a contractor role with hourly pay to be confirmed after the interview.

You will work asynchronously for at least 10 hours per week, across multi-page rubrics. Ideal candidates have evaluation or annotation experience with Spanish language content and a keen eye for detail,