Remote Music Production Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 32,000 - 74,000; Full time

Job summary

AI Trainer Jobs seeks a Music Production Expert - English to remotely review prompts and responses against AuraOne's rubric. You will compare paired outputs, label edge cases, and provide structured feedback to help retrain the model.

Ideal candidates have prior evaluation or annotation experience in music production English, strong attention to detail, and the ability to work asynchronously for at least 10 hours per week. Remote work within US eligibility is supported as a contractor role.

Qualifications

• Prior evaluation, annotation, or human-rater experience on music production english evaluation is required.
• Ability to apply rubrics consistently across long batches.
• Clear written reasoning naming the issue and rubric clause being applied.

Responsibilities

• Evaluate music production english evaluation model outputs against a versioned rubric and assign severity tags for assignments.
• Compare paired responses and pick the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them back to the program team for rubric updates.

Skills

Evaluation experience

Annotation experience

Attention to detail

Async availability

Job description

AI Trainer Jobs seeks a Music Production Expert - English to remotely review prompts and responses against AuraOne's rubric. You will compare paired outputs, label edge cases, and provide structured feedback to help retrain the model.

Ideal candidates have prior evaluation or annotation experience in music production English, strong attention to detail, and the ability to work asynchronously for at least 10 hours per week. Remote work within US eligibility is supported as a contractor role.