Remote Music & Lyrics Quality Evaluator

AI Trainer Jobs; United States; Remote; USD 41,000 - 74,000; Full time

Job summary

AI Trainer Jobs is seeking a Music & Lyrics Expert - English (US/UK/Australia) for remote evaluation work reviewing prompts and responses against AuraOne's quality rubric.

This contractor role pays $23–$54 per hour, with remote US eligibility; candidates should have experience in linguistic evaluation and strong attention to rubric details.

Responsibilities include evaluating model outputs, labeling issues, and providing structured feedback to help retrain the model.

Qualifications

• Prior evaluation or annotation experience on music lyrics evaluation.
• Ability to apply rubrics consistently across long batches.
• Clear written reasoning naming the issue and rubric clause.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate model outputs against the rubric and assign severity tags.
• Compare paired responses and justify the stronger answer.
• Label hallucinations, policy violations with structured tags.
• Capture ambiguous prompts for rubric updates.

Skills

Music Lyrics English evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

Model output evaluation

Job description

AI Trainer Jobs is seeking a Music & Lyrics Expert - English (US/UK/Australia) for remote evaluation work reviewing prompts and responses against AuraOne's quality rubric.

This contractor role pays $23–$54 per hour, with remote US eligibility; candidates should have experience in linguistic evaluation and strong attention to rubric details.

Responsibilities include evaluating model outputs, labeling issues, and providing structured feedback to help retrain the model.