Remote Spanish Music & Lyrics Evaluation Specialist (MX)

AuraOne; United States; On-site; USD 18,000 - 74,000; Full time

Benefits offered by this job

Remote work

Contractor status

Job summary

AuraOne is seeking a Music & Lyrics Expert - Spanish (MX) to remotely evaluate Spanish generalist outputs against our quality rubric. You will compare paired responses, label edge cases, and provide structured feedback to retrain the model.

This contractor role requires strong attention to detail, clear written reasoning, and the ability to work asynchronously for at least 10 hours per week; US work authorization is required.

Qualifications

• Prior evaluation, annotation, or human-rater experience on Spanish generalist evaluation.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning naming the issue and the rubric clause.

Responsibilities

• Evaluate model outputs against rubric and assign severity tags for Music & Lyrics Expert - Spanish (MX) assignments.
• Compare paired responses and select the stronger answer with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with tags.
• Capture ambiguous prompts and route them for rubric updates.
• Calibrate reviewer-quality scores against gold-standard examples weekly.
• Document recurring failure modes for future training.

Skills

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

Spanish generalist evaluation

Job description

AuraOne is seeking a Music & Lyrics Expert - Spanish (MX) to remotely evaluate Spanish generalist outputs against our quality rubric. You will compare paired responses, label edge cases, and provide structured feedback to retrain the model.

This contractor role requires strong attention to detail, clear written reasoning, and the ability to work asynchronously for at least 10 hours per week; US work authorization is required.