Remote Thai Music Audio Evaluator

AI Trainer Jobs; United States; Remote; USD 18,000 - 32,000; Full time

Job summary

AuraOne seeks a Music Audio Expert - Thai to remotely review Thai prompts and responses against its quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to retrain the model.

This contractor role involves judging voice and speech tasks and aiding in calibration processes with a flexible weekly schedule. As a contractor, you will handle 50-row batch audits, annotate issues, and contribute to inter-rater alignment.

Qualifications

• Experience evaluating thai generalist evaluation or adjacent content.
• Ability apply multi-page rubrics consistently.
• Clear written reasoning naming the issue and rubric clause.
• Reliable async availability for 10 hours per week.

Responsibilities

• Evaluate thai generalist evaluation model outputs against rubric and assign severity tags for Music Audio Expert - Thai assignments.
• Compare paired responses and pick the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them back to the program team for rubric updates.
• Maintain reviewer-quality scores by calibrating against gold-standard examples each week.

Skills

Evaluation experience

Annotation

Attention to detail

Written reasoning

Async availability

Inter-rater calibration

Job description

AuraOne seeks a Music Audio Expert - Thai to remotely review Thai prompts and responses against its quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to retrain the model.

This contractor role involves judging voice and speech tasks and aiding in calibration processes with a flexible weekly schedule. As a contractor, you will handle 50-row batch audits, annotate issues, and contribute to inter-rater alignment.