Remote Brazilian Portuguese Annotator & Evaluator

AuraOne Human Data

United States

Remote

USD 34,000 - 62,000

Part time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AuraOne, Inc. seeks a remote evaluator to review Brazilian Portuguese generalist model outputs against a evolving rubric. You will label nuanced errors, justify decisions with rubric clauses, and contribute to calibration cycles for ongoing improvements.

Responsibilities include comparing outputs, tagging safety and instruction-following issues, and capturing edge cases for retraining workstreams. Suitable for contractors with strong linguistic and analytical skills.

Qualifications

  • Prior evaluation, annotation, or human-rater experience on Portuguese generalist evaluation or adjacent content for Brazilian Portuguese Audio and Voice Annotation Trainer work.
  • Clear written reasoning that names the issue and the rubric clause being applied.
  • Strong attention to detail and the ability to flag when a prompt itself is the problem.
  • Reliable async availability for at least 10 hours per week.

Responsibilities

  • Evaluate Portuguese generalist evaluation model outputs against a versioned rubric and assign severity tags for Brazilian Portuguese Audio and Voice Annotation Trainer assignments.
  • Compare paired responses and pick the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
  • Document recurring failure modes so the modeling team can target them in the next training run.

Skills

Model evaluation
Rubric annotation
Severity tagging
Inter-rater calibration
Portuguese evaluation
Communication
Linguistics

Job description

AuraOne, Inc. seeks a remote evaluator to review Brazilian Portuguese generalist model outputs against a evolving rubric. You will label nuanced errors, justify decisions with rubric clauses, and contribute to calibration cycles for ongoing improvements.

Responsibilities include comparing outputs, tagging safety and instruction-following issues, and capturing edge cases for retraining workstreams. Suitable for contractors with strong linguistic and analytical skills.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Brazilian Portuguese Evaluation Specialist
Remote Brazilian Portuguese Evaluation Specialist

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Remote Portuguese AI Quality Evaluator (Brazil)
Remote Portuguese AI Quality Evaluator (Brazil)

AuraOne Human Data • United States

Remote
USD 28,000 - 40,000
Remote work
US-eligible remote contract
Remote Portuguese Evaluation Specialist (Brazil)
Remote Portuguese Evaluation Specialist (Brazil)

AuraOne Human Data • United States

Remote
USD 34,000 - 55,000
Remote Portuguese Evaluation Specialist
Remote Portuguese Evaluation Specialist

Auraone • United States

Remote
USD 34,000 - 55,000
Remote European Portuguese Evaluation Specialist
Remote European Portuguese Evaluation Specialist

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Remote Brazilian Portuguese Evaluation Specialist
Remote Brazilian Portuguese Evaluation Specialist

Move2usajobs • United States

Remote
USD 28,000 - 207,000
Remote Portuguese AI Evaluation Specialist (Brazil)
Remote Portuguese AI Evaluation Specialist (Brazil)

AuraOne Human Data • United States

Remote
USD 34,000 - 55,000
Remote Portuguese Evaluation Specialist (Contractor)
Remote Portuguese Evaluation Specialist (Contractor)

AuraOne, Inc. • United States

Remote
USD 30,000 - 48,000
Brazilian Portuguese Audio and Voice Annotation Trainer
Brazilian Portuguese Audio and Voice Annotation Trainer

AuraOne Human Data • United States

Remote
USD 34,000 - 62,000
Remote Brazilian Portuguese Audio QA Engineer (TTS)
Remote Brazilian Portuguese Audio QA Engineer (TTS)

Auraone • United States

Remote
USD 55,000 - 83,000
Remote work
Contractor