Remote AI Quality Analyst - Portuguese (Portugal) Contractor

AuraOne Human Data

United States

Remote

USD 17,000 - 24,000

Part time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AuraOne Human Data is seeking an AI Quality Analyst for Portuguese (Portugal) to remotely evaluate model outputs against a quality rubric and provide structured feedback. This contractor role focuses on labeling edge cases, marking failures, and generating actionable insights for retraining the model.

You will compare outputs, annotate with severity tags, and help calibrate performance across batches while maintaining high accuracy and thorough reasoning.

Qualifications

  • Experience evaluating AI content in Portuguese (Portugal) settings.
  • Ability to apply rubrics consistently across long batches.
  • Clear written reasoning naming the issue and rubric clause.
  • Detail-oriented reviewer who can flag prompt problems.
  • Reliable async availability for at least 10 hours per week.

Responsibilities

  • Evaluate Portuguese generalist evaluation model outputs against a versioned rubric and assign severity tags.
  • Compare paired responses and select the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Calibrate reviewer quality against gold-standard examples weekly.
  • Document recurring failure modes for future training iterations.

Skills

Model output evaluation
Rubric-based annotation
Severity tagging
Inter-rater calibration
Portuguese generalist evaluation
Domain-Specific Languages

Job description

AuraOne Human Data is seeking an AI Quality Analyst for Portuguese (Portugal) to remotely evaluate model outputs against a quality rubric and provide structured feedback. This contractor role focuses on labeling edge cases, marking failures, and generating actionable insights for retraining the model.

You will compare outputs, annotate with severity tags, and help calibrate performance across batches while maintaining high accuracy and thorough reasoning.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Quality Analyst: Personalization (Portuguese)
Remote AI Quality Analyst: Personalization (Portuguese)

AuraOne Human Data • United States

Remote
USD 17,000 - 24,000
Remote Portuguese AI Quality Evaluator (Brazil)
Remote Portuguese AI Quality Evaluator (Brazil)

AuraOne Human Data • United States

Remote
USD 28,000 - 40,000
Remote work
US-eligible remote contract
Remote Portuguese Evaluation Specialist
Remote Portuguese Evaluation Specialist

Auraone • United States

Remote
USD 34,000 - 55,000
AI Quality Analyst - Portuguese (Portugal)
AI Quality Analyst - Portuguese (Portugal)

AuraOne Human Data • United States

Remote
USD 17,000 - 24,000
Remote Portuguese AI Evaluation Specialist (Brazil)
Remote Portuguese AI Evaluation Specialist (Brazil)

AuraOne Human Data • United States

Remote
USD 34,000 - 55,000
AI Quality Analyst (Personalization) - Portuguese
AI Quality Analyst (Personalization) - Portuguese

AuraOne Human Data • United States

Remote
USD 17,000 - 24,000
Remote AI Quality Analyst (Spanish, Personalization)
Remote AI Quality Analyst (Spanish, Personalization)

AuraOne Human Data • United States

Remote
USD 17,000 - 24,000
Remote AI Quality Evaluator - English Evaluation
Remote AI Quality Evaluator - English Evaluation

AuraOne, Inc. • United States

Remote
USD 34,000 - 55,000
Remote European Portuguese Evaluation Specialist
Remote European Portuguese Evaluation Specialist

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Remote AI Quality Analyst (Personalization) - Polish Expert
Remote AI Quality Analyst (Personalization) - Polish Expert

AuraOne Human Data • United States

Remote
USD 23,000 - 32,000