Remote Thai Evaluation Specialist—Quality & Feedback

AI Trainer Jobs; United States; Remote; USD 34,000 - 69,000; Full time

Job summary

AuraOne is seeking a Thai Language Expert for a remote evaluation track. You will review Thai outputs against a quality rubric, label edge cases, and draft structured feedback for retraining the model.

Responsibilities include comparing paired responses, tagging issues, and calibrating scores weekly. Prior experience in linguistics, moderation, or trust & safety is preferred. This is a contractor role with flexible hours and US-eligibility for remote work.

Qualifications

• Thai language proficiency and linguistic background.
• Experience with evaluation, annotation, or human raters.
• Ability to apply multi-page rubrics consistently.
• Clear written reasoning naming issues and rubric clauses.

Responsibilities

• Evaluate Thai language outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger with a rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Flag prompts for rubric updates and calibration duties.
• Maintain reviewer quality scores and calibrate against gold standards.

Skills

Thai language

Linguistics

Content moderation

Inter-rater calibration

Job description

AuraOne is seeking a Thai Language Expert for a remote evaluation track. You will review Thai outputs against a quality rubric, label edge cases, and draft structured feedback for retraining the model.

Responsibilities include comparing paired responses, tagging issues, and calibrating scores weekly. Prior experience in linguistics, moderation, or trust & safety is preferred. This is a contractor role with flexible hours and US-eligibility for remote work.