Remote Spanish Linguistic Evaluator & Rubric Calibrator

AI Trainer Jobs; United States; Remote; USD 55,000 - 83,000; Full time

Job summary

AuraOne is seeking a Spanish Linguistic Expert for remote evaluation work. You will review Spanish generalist evaluation prompts and responses, label edge cases, and provide structured feedback to support retraining of models.

You will compare paired outputs, assign severity tags, and help ensure consistency across long review batches. The role emphasizes clear written reasoning, rubric application, and reliable async availability for at least 10 hours per week.

Qualifications

• Prior evaluation or annotation experience on Spanish generalist evaluation.
• Ability to apply a multi-page rubric consistently.
• Clear written reasoning naming issues and rubric clauses.

Responsibilities

• Evaluate Spanish generalist evaluation model outputs against a rubric.
• Compare paired responses and select the stronger with rationale.
• Label hallucinations and safety issues with structured tags.
• Capture ambiguous prompts and flag for rubric updates.
• Calibrate reviewer scores against gold-standard examples weekly.

Skills

Evaluation experience

Annotation

Linguistics background

Inter-rater calibration

Job description

AuraOne is seeking a Spanish Linguistic Expert for remote evaluation work. You will review Spanish generalist evaluation prompts and responses, label edge cases, and provide structured feedback to support retraining of models.

You will compare paired outputs, assign severity tags, and help ensure consistency across long review batches. The role emphasizes clear written reasoning, rubric application, and reliable async availability for at least 10 hours per week.