Italian Music Audio QA Expert - Remote Evaluation

AI Trainer Jobs; United States; Remote; USD 28,000 - 80,000; Full time

Job summary

AuraOne is seeking a Music Audio Expert - Italian for a remote evaluation track. Reviewers compare outputs, label edge cases, and create structured feedback to retrain the modeling team.

This is a contractor role with flexible volume and remote work. Responsibilities include evaluating Italian generalist evaluation model outputs against a versioned rubric, labeling issues, and maintaining calibration with gold-standard examples weekly.

Qualifications

• Prior evaluation or annotation experience on Italian generalist evaluation tasks.

Responsibilities

• Evaluate italian generalist evaluation model outputs against rubric.
• Compare paired responses and justify selection.
• Label hallucinations and safety content with tags.
• Flag ambiguous prompts for rubric updates.
• Calibrate reviewer scores against gold standards weekly.

Skills

Italian evaluation

Annotation

Inter-rater calibration

Job description

AuraOne is seeking a Music Audio Expert - Italian for a remote evaluation track. Reviewers compare outputs, label edge cases, and create structured feedback to retrain the modeling team.

This is a contractor role with flexible volume and remote work. Responsibilities include evaluating Italian generalist evaluation model outputs against a versioned rubric, labeling issues, and maintaining calibration with gold-standard examples weekly.