Remote Mandarin AI Evaluation & Annotation Specialist

AuraOne Human Data

United States

Remote

USD 34,000 - 62,000

Part time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AuraOne, Inc. seeks a Mandarin Chinese AI Evaluation and Annotation Specialist to work remotely as an independent contractor. You will review model outputs for fluency, accuracy, register, and cultural fit against native-speaker norms, and write structured rationales to guide training cycles.

Responsibilities include scoring paired Chinese responses, selecting the better option with justification, flagging errors, and capturing native edits to illustrate correct phrasing.

Qualifications

  • Native or near-native Chinese fluency with strong written-English ability.
  • Experience editing, translating, or evaluating Chinese content.
  • Ability to apply rubrics consistently across long evaluation batches.
  • Clear written reasoning naming the issue and the standard.
  • Reliable async availability for at least 10 hours per week.
  • Prior model-evaluation, annotation, or human-rater experience is a plus.

Responsibilities

  • Evaluate Chinese model outputs for fluency, accuracy, register, and cultural fit.
  • Compare paired Mandarin evaluation outputs and pick the stronger response with rationale.
  • Flag hallucinations, code-switching errors, and formality mismatches with task-specific severity tags.
  • Capture native-speaker edits that demonstrate the correct phrasing alongside each issue.
  • Calibrate against the AuraOne Chinese rubric in weekly reviewer-quality cycles.
  • Surface ambiguous prompts back to the program team so the rubric can be sharpened.
  • Maintain reviewer notes that document tricky idioms, regionalisms, and emerging usage.

Skills

Multilingual evaluation
Native-speaker review
Rubric application
LLM output evaluation
Mandarin evaluation

Education

Background in Chinese linguistics, journalism, or translation studies

Tools

TMS tools
MQM error taxonomies

Job description

AuraOne, Inc. seeks a Mandarin Chinese AI Evaluation and Annotation Specialist to work remotely as an independent contractor. You will review model outputs for fluency, accuracy, register, and cultural fit against native-speaker norms, and write structured rationales to guide training cycles.

Responsibilities include scoring paired Chinese responses, selecting the better option with justification, flagging errors, and capturing native edits to illustrate correct phrasing.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Mandarin AI Evaluation Specialist
Remote Mandarin AI Evaluation Specialist

Auraone • United States

Remote
USD 68,000 - 97,000
Remote Chinese AI Evaluation Specialist
Remote Chinese AI Evaluation Specialist

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Mandarin Chinese AI Evaluation and Annotation Specialist
Mandarin Chinese AI Evaluation and Annotation Specialist

AuraOne Human Data • United States

Remote
USD 34,000 - 62,000
Mandarin HR Data Evaluator | Remote Contractor
Mandarin HR Data Evaluator | Remote Contractor

AuraOne, Inc. • United States

Remote
USD 83,000 - 96,000
Mandarin Evaluation Specialist — Remote Rubric & Feedback
Mandarin Evaluation Specialist — Remote Rubric & Feedback

Auraone • United States

Remote
USD 34,000 - 48,000
Remote TC Linguistic Expert for AI Evaluation & Review
Remote TC Linguistic Expert for AI Evaluation & Review

AuraOne Human Data • United States

Remote
USD 50,000 - 61,000
Remote Taiwanese Chinese AI Evaluation Specialist
Remote Taiwanese Chinese AI Evaluation Specialist

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Remote Chinese Voice Evaluation Specialist for AI Feedback
Remote Chinese Voice Evaluation Specialist for AI Feedback

Auraone • United States

Remote
USD 62,000 - 76,000
Remote Simplified Chinese Evaluation Specialist
Remote Simplified Chinese Evaluation Specialist

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Remote work
Independent contractor
Remote Chinese Evaluation & Rubric Specialist
Remote Chinese Evaluation & Rubric Specialist

AuraOne, Inc. • United States

Remote
USD 57,000 - 81,000