Remote Portuguese Language Model Evaluator

AuraOne; United States; À distance; USD 34 000 - 62 000; Temps partiel

Résumé du poste

AI Trainer Jobs seeks a Business Document Expert (Portuguese Speaker) to remotely evaluate Portuguese generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and provide structured feedback for retraining.

Independent contractor role with flexible hours; required to provide clear written reasoning and consistent rubric application. Hourly rates are set after the interview process.

Qualifications

• Experience in evaluating language data using rubrics.
• Ability to apply rubrics consistently across long batches.
• Clear written reasoning that names the issue and rubric clause.
• Reliable async availability for at least 10 hours per week.

Responsabilités

• Evaluate Portuguese generalist evaluation model outputs against a rubric and assign severity tags.
• Compare paired responses and provide rationale for selecting the stronger answer.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them for rubric updates.

Connaissances

Evaluation experience

Annotation experience

Portuguese proficiency

Attention to detail

Async availability

Description du poste

AI Trainer Jobs seeks a Business Document Expert (Portuguese Speaker) to remotely evaluate Portuguese generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and provide structured feedback for retraining.

Independent contractor role with flexible hours; required to provide clear written reasoning and consistent rubric application. Hourly rates are set after the interview process.