Remote Portuguese Music & Lyrics Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 25,000 - 58,000; Full time

Job summary

AuraOne is seeking a Music & Lyrics Expert - Portuguese for a remote evaluation track. You will review Portuguese generalist evaluation prompts and responses against AuraOne's quality rubric, compare paired outputs, label edge cases, and write the structured feedback the modeling team can use to retrain.

As an independent contractor, you will help turn evaluation results into auditable labels, rationales, and regression cases for AuraOne Human Data, review frontier model outputs, judge benchmark

Qualifications

• Experience with Portuguese generalist evaluation or adjacent content.
• Ability to apply multi-page rubrics consistently.
• Clear written reasoning citing rubric clauses.

Responsibilities

• Evaluate Portuguese outputs against a versioned rubric and assign severity tags.
• Compare paired responses and justify the stronger answer.
• Label hallucinations and unsafe content with structured tags.
• Capture ambiguous prompts and flag for rubric updates.

Skills

Evaluation experience

Rubric annotation

Written reasoning

Attention to detail

Async availability

Job description

AuraOne is seeking a Music & Lyrics Expert - Portuguese for a remote evaluation track. You will review Portuguese generalist evaluation prompts and responses against AuraOne's quality rubric, compare paired outputs, label edge cases, and write the structured feedback the modeling team can use to retrain.

As an independent contractor, you will help turn evaluation results into auditable labels, rationales, and regression cases for AuraOne Human Data, review frontier model outputs, judge benchmark