Remote Chinese Linguistic Expert for AI Evaluation

AuraOne Human Data

United States

Remote

USD 45,000 - 65,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Key tasks include comparing outputs, selecting the stronger answer with rationale, tagging safety categories, and documenting recurring failure modes for model improvement. Remote work, US-eligible contractor role, 40 USD per hour.

Qualifications

  • Experience evaluating Chinese generalist prompts or similar content.
  • Ability to apply rubrics consistently across long batches.
  • Clear written reasoning that references rubric clauses.

Responsibilities

  • Evaluate Chinese generalist evaluation model outputs against a versioned rubric and assign severity tags.
  • Compare paired responses and provide a written rationale for the stronger answer.
  • Label hallucinations, instruction-following failures and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples weekly.

Skills

Chinese generalist evaluation
Inter-rater calibration
Rubric-based annotation
Severity tagging
Model output evaluation

Job description

Key tasks include comparing outputs, selecting the stronger answer with rationale, tagging safety categories, and documenting recurring failure modes for model improvement. Remote work, US-eligible contractor role, 40 USD per hour.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Chinese AI Evaluation Specialist
Remote Chinese AI Evaluation Specialist

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Remote TC Linguistic Expert for AI Evaluation & Review
Remote TC Linguistic Expert for AI Evaluation & Review

AuraOne Human Data • United States

Remote
USD 50,000 - 61,000
Chinese (Hong Kong SAR China) Linguistic Expert — AI Evaluation
Chinese (Hong Kong SAR China) Linguistic Expert — AI Evaluation

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Remote Simplified Chinese Evaluation Specialist
Remote Simplified Chinese Evaluation Specialist

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Remote work
Independent contractor
Remote Taiwanese Chinese AI Evaluation Specialist
Remote Taiwanese Chinese AI Evaluation Specialist

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Remote Mandarin AI Evaluation Specialist
Remote Mandarin AI Evaluation Specialist

Auraone • United States

Remote
USD 68,000 - 97,000
Chinese (China) Linguistic Expert — AI Evaluation
Chinese (China) Linguistic Expert — AI Evaluation

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Remote work
Flexible hours
Chinese (Singapore) Linguistic Expert — AI Evaluation
Chinese (Singapore) Linguistic Expert — AI Evaluation

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Chinese (Taiwan) Linguistic Expert — AI Evaluation
Chinese (Taiwan) Linguistic Expert — AI Evaluation

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Remote Chinese Evaluation & Rubric Specialist
Remote Chinese Evaluation & Rubric Specialist

AuraOne, Inc. • United States

Remote
USD 57,000 - 81,000