Spanish Evaluation Reviewer (Remote, Contract)

AuraOne

San Jose (CA)

Remote

USD 83,000 - 96,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Wishalicious is seeking remote reviewers to evaluate Spanish generalist evaluation outputs against AuraOne's rubric. You will compare paired responses, assign severity tags, and write concise rationales to help retrain the model.

The role emphasizes labeling unsafe content, hallucinations, and instruction-following failures with structured tags, while maintaining calibration against gold-standard examples across batches.

Qualifications

  • Experience evaluating model outputs against defined rubrics.
  • Ability to annotate and label prompts and outputs with structured feedback.
  • Familiarity with inter-rater reliability concepts and calibration cycles.

Responsibilities

  • Evaluate Spanish generalist evaluation model outputs against a versioned rubric.
  • Assign severity tags for Spanish Tutors assignments with written rationale.
  • Compare paired responses and select the stronger answer.
  • Label hallucinations and safety issues with structured tags.
  • Capture ambiguous prompts and route to rubric updates; calibrate scores weekly.

Skills

Spanish generalist evaluation
Rubric-based annotation
Inter-rater calibration
Attention to detail
Written reasoning

Job description

Wishalicious is seeking remote reviewers to evaluate Spanish generalist evaluation outputs against AuraOne's rubric. You will compare paired responses, assign severity tags, and write concise rationales to help retrain the model.

The role emphasizes labeling unsafe content, hallucinations, and instruction-following failures with structured tags, while maintaining calibration against gold-standard examples across batches.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Spanish Evaluation & Feedback Specialist
Remote Spanish Evaluation & Feedback Specialist

Auraone • United States

Remote
USD 83,000 - 96,000
Remote Spanish Linguistic Evaluator & Rubric Calibrator
Remote Spanish Linguistic Evaluator & Rubric Calibrator

Auraone • United States

Remote
USD 55,000 - 83,000
Spanish (Spain) Evaluation Specialist - Remote Contract
Spanish (Spain) Evaluation Specialist - Remote Contract

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Remote Spanish Evaluation Specialist
Remote Spanish Evaluation Specialist

Auraone • United States

Remote
USD 34,000 - 55,000
Remote work
Contractor engagement
US-eligible
Remote Spanish Language Evaluator (Spain) - Model Eval
Remote Spanish Language Evaluator (Spain) - Model Eval

Auraone • United States

Remote
USD 28,000 - 55,000
Remote work
Remote Spanish Evaluation Specialist
Remote Spanish Evaluation Specialist

Auraone • United States

Remote
USD 68,000 - 97,000
Remote Spanish Voice Actors Evaluation Specialist
Remote Spanish Voice Actors Evaluation Specialist

AuraOne Human Data • United States

Remote
USD 28,000 - 55,000
Remote Spanish Evaluation Specialist (Mexico)
Remote Spanish Evaluation Specialist (Mexico)

AuraOne, Inc. • United States

Remote
USD 28,000 - 55,000
Mexican Spanish Linguistic Expert (Remote)
Mexican Spanish Linguistic Expert (Remote)

AuraOne Human Data • United States

Remote
USD 47,000 - 63,000
Mexican Spanish Linguistic Reviewer (Remote)
Mexican Spanish Linguistic Reviewer (Remote)

AuraOne Human Data • United States

Remote
USD 47,000 - 63,000