LATAM Spanish Evaluation Specialist (Remote)

AuraOne Human Data

United States

Remote

USD 34.000 - 55.000

Teilzeit

Vor 2 Tagen
Sei unter den ersten Bewerbenden

Erhalte eine Antwort von diesem Arbeitgeber

Dein Lebenslauf und dein Anschreiben, genau auf das zugeschnitten, was gesucht wird.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

AuraOne, Inc. is seeking a remote Spanish Language Expert (LATAM) to review model outputs against a versioned rubric, label edge cases, and provide structured feedback for retraining.

This contractor role emphasizes careful evaluation, clear rationale, and consistency across long batches. Responsibilities include comparing paired responses, labeling unsafe content, and documenting recurring failure modes to guide future rubric updates.

Qualifikationen

  • Prior evaluation, annotation, or human-rater experience on spanish generalist evaluation or adjacent content.
  • Clear written reasoning that names the issue and the rubric clause being applied.
  • Strong attention to detail and the ability to flag when a prompt itself is the problem.
  • Reliable async availability for at least 10 hours per week.

Aufgaben

  • Evaluate spanish generalist evaluation model outputs against a versioned rubric and assign severity tags for Spanish Language Expert (LATAM) assignments.
  • Compare paired responses and pick the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
  • Document recurring failure modes so the modeling team can target them in the next training run.

Kenntnisse

Model output evaluation
Rubric-based annotation
Severity tagging
Inter-rater calibration
Spanish generalist evaluation

Jobbeschreibung

AuraOne, Inc. is seeking a remote Spanish Language Expert (LATAM) to review model outputs against a versioned rubric, label edge cases, and provide structured feedback for retraining.

This contractor role emphasizes careful evaluation, clear rationale, and consistency across long batches. Responsibilities include comparing paired responses, labeling unsafe content, and documenting recurring failure modes to guide future rubric updates.

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Remote LATAM Spanish Evaluation & Feedback Specialist
Remote LATAM Spanish Evaluation & Feedback Specialist

AuraOne Human Data • USA

Remote
USD 45.000 - 65.000
Remote Spanish Evaluation Specialist
Remote Spanish Evaluation Specialist

Auraone • USA

Remote
USD 34.000 - 55.000
Remote work
Contractor engagement
US-eligible
Remote Spanish Linguistic Evaluator & Rubric Calibrator
Remote Spanish Linguistic Evaluator & Rubric Calibrator

Auraone • USA

Remote
USD 55.000 - 83.000
Spanish (Spain) Evaluation Specialist - Remote Contract
Spanish (Spain) Evaluation Specialist - Remote Contract

AuraOne Human Data • USA

Remote
USD 45.000 - 65.000
Mexican Spanish Linguistic Reviewer (Remote)
Mexican Spanish Linguistic Reviewer (Remote)

AuraOne Human Data • USA

Remote
USD 47.000 - 63.000
Remote Spanish Evaluation Specialist (Mexico)
Remote Spanish Evaluation Specialist (Mexico)

AuraOne, Inc. • USA

Remote
USD 28.000 - 55.000
Remote Spanish (Chile) Linguistic Quality Reviewer
Remote Spanish (Chile) Linguistic Quality Reviewer

AuraOne Human Data • USA

Remote
USD 45.000 - 65.000
Remote Spanish Evaluation Specialist
Remote Spanish Evaluation Specialist

Auraone • USA

Remote
USD 68.000 - 97.000
Spanish Language Expert (LATAM)
Spanish Language Expert (LATAM)

AuraOne Human Data • USA

Remote
USD 34.000 - 55.000
Remote Spanish Language Evaluator (Spain) - Model Eval
Remote Spanish Language Evaluator (Spain) - Model Eval

Auraone • USA

Remote
USD 28.000 - 55.000
Remote work