Remote Spanish Evaluation & Feedback Specialist

Auraone

United States

Remote

USD 83,000 - 96,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AuraOne is seeking remote reviewers to evaluate Spanish generalist prompts and responses against its quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback for retraining.

As a reviewer, you will label hallucinations and safety issues, route ambiguous prompts to the program team, and calibrate scores against gold-standard examples each week. The role is about 10 hours weekly as a contractor with pay of $60–$70 per hour.

Qualifications

  • Prior evaluation, annotation, or human-rater experience on Spanish content.
  • Ability to apply multi-page rubrics consistently across long batches.
  • Clear written reasoning naming the issue and rubric clause.

Responsibilities

  • Evaluate spanish generalist evaluation model outputs against a versioned rubric and assign severity tags.
  • Compare paired responses and select the stronger answer with a rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them to the program team for rubric updates.
  • Calibrate reviewer-quality scores against gold-standard examples weekly.

Skills

Evaluation experience
Spanish proficiency
Attention to detail
Async availability

Job description

AuraOne is seeking remote reviewers to evaluate Spanish generalist prompts and responses against its quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback for retraining.

As a reviewer, you will label hallucinations and safety issues, route ambiguous prompts to the program team, and calibrate scores against gold-standard examples each week. The role is about 10 hours weekly as a contractor with pay of $60–$70 per hour.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Spanish Evaluation Specialist
Remote Spanish Evaluation Specialist

Auraone • United States

Remote
USD 34,000 - 55,000
Remote work
Contractor engagement
US-eligible
Spanish (Spain) Evaluation Specialist - Remote Contract
Spanish (Spain) Evaluation Specialist - Remote Contract

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Remote Spanish Linguistic Evaluator & Rubric Calibrator
Remote Spanish Linguistic Evaluator & Rubric Calibrator

Auraone • United States

Remote
USD 55,000 - 83,000
Remote Spanish Evaluation Specialist
Remote Spanish Evaluation Specialist

Auraone • United States

Remote
USD 68,000 - 97,000
Remote Spanish Voice Actors Evaluation Specialist
Remote Spanish Voice Actors Evaluation Specialist

AuraOne Human Data • United States

Remote
USD 28,000 - 55,000
Remote Spanish Language Evaluator (Spain) - Model Eval
Remote Spanish Language Evaluator (Spain) - Model Eval

Auraone • United States

Remote
USD 28,000 - 55,000
Remote work
Spanish Evaluation Reviewer (Remote, Contract)
Spanish Evaluation Reviewer (Remote, Contract)

AuraOne • San Jose (CA)

Remote
USD 83,000 - 96,000
Remote LATAM Spanish Evaluation & Feedback Specialist
Remote LATAM Spanish Evaluation & Feedback Specialist

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Remote Spanish Evaluation Specialist (Mexico)
Remote Spanish Evaluation Specialist (Mexico)

AuraOne, Inc. • United States

Remote
USD 28,000 - 55,000
Remote Spanish-Language AI Quality Reviewer
Remote Spanish-Language AI Quality Reviewer

Auraone • United States

Remote
USD 30,000 - 48,000