Remote Spanish AI Evaluation Specialist - Quality Labels

AuraOne Human Data

United States

Remote

USD 28,000 - 40,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Remote work
Contractor employment

Job summary

AuraOne Human Data seeks a Remote Spanish AI Evaluation Specialist (Mexico) to evaluate and label Spanish outputs using a versioned rubric. You will compare paired responses, tag issues, and write rationales for the modeling team to retrain.

This contractor role requires reliable weekly availability and strong attention to detail to identify errors and suggest rubric clarifications for ongoing improvements.

Qualifications

  • Prior evaluation, annotation, or human-rater experience on spanish generalist evaluation or adjacent content for Spanish AI Evaluation Specialist (Mexico) work.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the issue and the rubric clause being applied.
  • Strong attention to detail and the ability to flag when a prompt itself is the problem.

Responsibilities

  • Evaluate Spanish generalist evaluation model outputs against a versioned rubric and assign severity tags.
  • Compare paired responses and select the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
  • Document recurring failure modes for the modeling team to address in training.

Skills

Model output evaluation
Rubric-based annotation
Severity tagging
Inter-rater calibration
Spanish generalist evaluation
AI model evaluation

Job description

AuraOne Human Data seeks a Remote Spanish AI Evaluation Specialist (Mexico) to evaluate and label Spanish outputs using a versioned rubric. You will compare paired responses, tag issues, and write rationales for the modeling team to retrain.

This contractor role requires reliable weekly availability and strong attention to detail to identify errors and suggest rubric clarifications for ongoing improvements.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Spanish AI Evaluation Analyst
Remote Spanish AI Evaluation Analyst

AuraOne Human Data • United States

Remote
USD 28,000 - 50,000
Remote AI Quality Analyst (Spanish, Personalization)
Remote AI Quality Analyst (Spanish, Personalization)

AuraOne Human Data • United States

Remote
USD 17,000 - 24,000
Remote Spanish Annotation & Evaluation Specialist
Remote Spanish Annotation & Evaluation Specialist

AuraOne Human Data • United States

Remote
USD 28,000 - 41,000
Remote Spanish Evaluation Specialist (Mexico)
Remote Spanish Evaluation Specialist (Mexico)

AuraOne, Inc. • United States

Remote
USD 28,000 - 55,000
Remote Spanish Voice Actors Evaluation Specialist
Remote Spanish Voice Actors Evaluation Specialist

AuraOne Human Data • United States

Remote
USD 28,000 - 55,000
Remote Spanish-Language AI Quality Reviewer
Remote Spanish-Language AI Quality Reviewer

Auraone • United States

Remote
USD 30,000 - 48,000
Remote Spanish Evaluation Specialist
Remote Spanish Evaluation Specialist

Auraone • United States

Remote
USD 68,000 - 97,000
Mexican Spanish Evaluator (Remote) | Model QA & Feedback
Mexican Spanish Evaluator (Remote) | Model QA & Feedback

Auraone • United States

Remote
USD 14,000 - 21,000
Remote Spanish AI Evaluation Specialist
Remote Spanish AI Evaluation Specialist

Auraone • United States

Remote
USD 44,000 - 61,000
Remote Spanish Linguistic Evaluator & Rubric Calibrator
Remote Spanish Linguistic Evaluator & Rubric Calibrator

Auraone • United States

Remote
USD 55,000 - 83,000