Remote Thai Audio Evaluation Specialist – Rubric Review

AuraOne; United States; Remote; USD 59.000 - 79.000; Vollzeit

Zusammenfassung

AuraOne is seeking a remote Thai Audio Recording Expert contract role. Work involves evaluating Thai generalist evaluation outputs against a versioned rubric, tagging issues, and providing structured feedback to retrain models. Role emphasizes accuracy, consistency, and clear written reasoning.

Responsibilities include comparing responses, labeling edge cases, and calibrating scores weekly. This is a contractor position with US eligibility and hourly compensation, starting after interview

Qualifikationen

• Thai language proficiency required.
• Strong attention to detail and accuracy in labeling.
• Ability to work asynchronously and meet weekly targets.

Aufgaben

• Evaluate Thai generalist evaluation model outputs against a rubric and assign severity tags.
• Compare paired responses and select the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and refer them for rubric updates.
• Maintain reviewer quality scores by calibration against gold-standard examples.

Kenntnisse

Thai language

Attention to detail

Remote work

Jobbeschreibung

AuraOne is seeking a remote Thai Audio Recording Expert contract role. Work involves evaluating Thai generalist evaluation outputs against a versioned rubric, tagging issues, and providing structured feedback to retrain models. Role emphasizes accuracy, consistency, and clear written reasoning.

Responsibilities include comparing responses, labeling edge cases, and calibrating scores weekly. This is a contractor position with US eligibility and hourly compensation, starting after interview