Remote Brazilian Portuguese Evaluation Specialist

AuraOne Human Data

United States

Remote

USD 45.000 - 65.000

Vollzeit

14 Tage+

Eine vollständige Bewerbung in einer Minute

Maßgeschneiderter Lebenslauf und Anschreiben – versandbereit.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

AuraOne, Inc. is seeking a Brazilian Portuguese Linguistic Expert for a remote evaluation track.

You will review Portuguese generalist prompts and responses against AuraOne's quality rubric, compare paired outputs, label edge cases, and draft structured feedback for model retraining. Responsibilities include evaluating outputs, assigning severity tags, labeling hallucinations and unsafe content, and documenting recurring issues for rubric updates.

Qualifikationen

  • Experience evaluating Portuguese generalist evaluation or adjacent content.
  • Ability to apply multi-page rubrics consistently.
  • Clear written reasoning naming the issue and rubric clause.
  • Attention to detail and ability to flag prompt problems.
  • Reliable async availability for 10+ hours per week.

Aufgaben

  • Evaluate Portuguese generalist evaluation model outputs against rubric and assign severity tags.
  • Compare paired responses and provide rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples weekly.
  • Document recurring failure modes for the modeling team to target in training.

Kenntnisse

Model output evaluation
Rubric-based annotation
Severity tagging
Inter-rater calibration
Portuguese generalist evaluation

Jobbeschreibung

AuraOne, Inc. is seeking a Brazilian Portuguese Linguistic Expert for a remote evaluation track.

You will review Portuguese generalist prompts and responses against AuraOne's quality rubric, compare paired outputs, label edge cases, and draft structured feedback for model retraining. Responsibilities include evaluating outputs, assigning severity tags, labeling hallucinations and unsafe content, and documenting recurring issues for rubric updates.

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Remote Portuguese Evaluation Specialist (Brazil)
Remote Portuguese Evaluation Specialist (Brazil)

AuraOne Human Data • USA

Remote
USD 34.000 - 55.000
Remote Brazilian Portuguese Evaluation Specialist
Remote Brazilian Portuguese Evaluation Specialist

Move2usajobs • USA

Remote
USD 28.000 - 207.000
Remote Portuguese AI Evaluation Specialist (Brazil)
Remote Portuguese AI Evaluation Specialist (Brazil)

AuraOne Human Data • USA

Remote
USD 34.000 - 55.000
Remote European Portuguese Evaluation Specialist
Remote European Portuguese Evaluation Specialist

AuraOne Human Data • USA

Remote
USD 45.000 - 65.000
Remote Portuguese Evaluation Specialist
Remote Portuguese Evaluation Specialist

Auraone • USA

Remote
USD 34.000 - 55.000
Remote Brazilian Portuguese Annotator & Evaluator
Remote Brazilian Portuguese Annotator & Evaluator

AuraOne Human Data • USA

Remote
USD 34.000 - 62.000
Remote Portuguese AI Quality Evaluator (Brazil)
Remote Portuguese AI Quality Evaluator (Brazil)

AuraOne Human Data • USA

Remote
USD 28.000 - 40.000
Remote work
US-eligible remote contract
Remote Brazilian Portuguese Audio QA Engineer (TTS)
Remote Brazilian Portuguese Audio QA Engineer (TTS)

Auraone • USA

Remote
USD 55.000 - 83.000
Remote work
Contractor
Remote Portuguese Evaluation Specialist (Contractor)
Remote Portuguese Evaluation Specialist (Contractor)

AuraOne, Inc. • USA

Remote
USD 30.000 - 48.000
Brazilian Portuguese Linguistic Expert
Brazilian Portuguese Linguistic Expert

AuraOne Human Data • USA

Remote
USD 45.000 - 65.000