Remote Thai AI Evaluation Analyst: Model Review & Feedback

AuraOne Human Data

United States

Remote

USD 30,000 - 55,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AuraOne, Inc. is seeking a remote Thai-Language Business Analyst to support AI evaluation and model review. The role focuses on turning evaluated Thai outputs into auditable labels, rationales, and regression cases for AuraOne Human Data within a contract framework.

Responsibilities include comparing model outputs, labeling issues with structured tags, and calibrating reviewer performance weekly. Strong attention to detail and async availability of 10+ hours weekly are required.

Qualifications

  • Experience with Thai generalist evaluation or related content.
  • Clear written reasoning that names the issue and rubric clause.
  • Strong attention to detail and ability to flag when a prompt is the problem.
  • Reliable async availability for at least 10 hours per week.

Responsibilities

  • Evaluate Thai generalist evaluation model outputs against a versioned rubric and assign severity tags.
  • Compare paired responses and select the stronger answer with written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
  • Document recurring failure modes for the modeling team.

Skills

Model output evaluation
Rubric-based annotation
Severity tagging
Inter-rater calibration
Thai generalist evaluation
Critical Thinking
Business Analysis

Job description

AuraOne, Inc. is seeking a remote Thai-Language Business Analyst to support AI evaluation and model review. The role focuses on turning evaluated Thai outputs into auditable labels, rationales, and regression cases for AuraOne Human Data within a contract framework.

Responsibilities include comparing model outputs, labeling issues with structured tags, and calibrating reviewer performance weekly. Strong attention to detail and async availability of 10+ hours weekly are required.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Thai Linguistic Reviewer for AI Output Evaluation
Remote Thai Linguistic Reviewer for AI Output Evaluation

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Thai-Language Business Analyst | AI Evaluation and Model Review
Thai-Language Business Analyst | AI Evaluation and Model Review

AuraOne Human Data • United States

Remote
USD 30,000 - 55,000
Remote Thai AI Quality Analyst — Personalization
Remote Thai AI Quality Analyst — Personalization

AuraOne Human Data • United States

Remote
USD 17,000 - 24,000
AI Quality Analyst (Personalization) - Thai
AI Quality Analyst (Personalization) - Thai

AuraOne Human Data • United States

Remote
USD 17,000 - 24,000
Remote Thai Linguistic Expert - AI Output Review & Rating
Remote Thai Linguistic Expert - AI Output Review & Rating

Move2usajobs • United States

Remote
USD 28,000 - 207,000
Remote Thai Audio Evaluation Specialist – Rubric Review
Remote Thai Audio Evaluation Specialist – Rubric Review

Auraone • United States

Remote
USD 59,000 - 79,000
Remote Malay AI Evaluation Analyst
Remote Malay AI Evaluation Analyst

AuraOne Human Data • United States

Remote
USD 28,000 - 48,000
Thai Bilingual Evaluation Specialist (Remote)
Thai Bilingual Evaluation Specialist (Remote)

Auraone • United States

Remote
USD 34,000 - 55,000
Remote Chinese AI Evaluation Analyst
Remote Chinese AI Evaluation Analyst

AuraOne Human Data • United States

Remote
USD 28,000 - 55,000
Thai Linguistic Expert — AI Output Review and Rating
Thai Linguistic Expert — AI Output Review and Rating

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000