Mandarin Chinese AI Evaluation and Annotation Specialist

AuraOne Human Data

United States

Remote

USD 34,000 - 62,000

Part time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AuraOne, Inc. seeks a Mandarin Chinese AI Evaluation and Annotation Specialist to work remotely as an independent contractor. You will review model outputs for fluency, accuracy, register, and cultural fit against native-speaker norms, and write structured rationales to guide training cycles.

Responsibilities include scoring paired Chinese responses, selecting the better option with justification, flagging errors, and capturing native edits to illustrate correct phrasing.

Qualifications

  • Native or near-native Chinese fluency with strong written-English ability.
  • Experience editing, translating, or evaluating Chinese content.
  • Ability to apply rubrics consistently across long evaluation batches.
  • Clear written reasoning naming the issue and the standard.
  • Reliable async availability for at least 10 hours per week.
  • Prior model-evaluation, annotation, or human-rater experience is a plus.

Responsibilities

  • Evaluate Chinese model outputs for fluency, accuracy, register, and cultural fit.
  • Compare paired Mandarin evaluation outputs and pick the stronger response with rationale.
  • Flag hallucinations, code-switching errors, and formality mismatches with task-specific severity tags.
  • Capture native-speaker edits that demonstrate the correct phrasing alongside each issue.
  • Calibrate against the AuraOne Chinese rubric in weekly reviewer-quality cycles.
  • Surface ambiguous prompts back to the program team so the rubric can be sharpened.
  • Maintain reviewer notes that document tricky idioms, regionalisms, and emerging usage.

Skills

Multilingual evaluation
Native-speaker review
Rubric application
LLM output evaluation
Mandarin evaluation

Education

Background in Chinese linguistics, journalism, or translation studies

Tools

TMS tools
MQM error taxonomies

Job description

Mandarin Chinese AI Evaluation and Annotation Specialist is a remote Chinese specialist track for evaluating mandarin evaluation outputs against native-speaker standards. Reviewers spot fluency, register, and cultural-context errors that automated checks miss, and write structured rationale that the modeling team can act on in the next training cycle.

Why this role matters

Multilingual model quality depends on reviewers who can read Chinese the way a native speaker does. AuraOne uses these reviewers to set the bar for tone, formality, and cultural register before a model ever ships to Chinese users.

Responsibilities
  • Evaluate Chinese model responses for fluency, accuracy, register, and cultural fit for Mandarin Chinese AI Evaluation and Annotation Specialist assignments.
  • Compare paired mandarin evaluation outputs and pick the stronger response with a written rationale.
  • Flag hallucinations, code-switching errors, and formality mismatches with task-specific severity tags.
  • Capture native-speaker edits that demonstrate the correct phrasing alongside each issue.
  • Calibrate against the AuraOne Chinese rubric in weekly reviewer-quality cycles.
  • Surface ambiguous prompts back to the program team so the rubric can be sharpened.
  • Maintain reviewer notes that document tricky idioms, regionalisms, and emerging usage.
Qualifications
  • Native or near-native Chinese fluency with strong written-English ability for Mandarin Chinese AI Evaluation and Annotation Specialist work.
  • Demonstrable experience editing, translating, or evaluating Chinese content.
  • Comfort applying multi-page rubrics consistently across long evaluation batches.
  • Clear written reasoning that names the issue and the standard being applied.
  • Reliable async availability for at least 10 hours per week.
  • Prior model-evaluation, annotation, or human-rater experience is a plus.
Example tasks
  • Score a pair of Chinese responses to a customer-support prompt and pick the better one with a 1-2 sentence rationale.
  • Flag formality mismatches in mandarin evaluation outputs (T/V usage, honorifics, regional register).
  • Rewrite a model's Chinese response so it reads naturally and tag the original error category.
  • Audit a 50-row evaluation batch for rubric consistency and surface drift back to the program lead.
Nice to have
  • Background in Chinese linguistics, journalism, or translation studies.
  • Experience with TMS tools, MQM error taxonomies, or other structured QA frameworks.
  • Familiarity with LLM evaluation rubrics and inter-rater agreement workflows.
Skills
  • Multilingual evaluation
  • Native-speaker review
  • Rubric application
  • LLM output evaluation
  • Mandarin evaluation
Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Native or near-native Chinese fluency with strong written-English ability for Mandarin Chinese AI Evaluation and Annotation Specialist work. Demonstrable experience editing, translating, or evaluating Chinese content. Comfort applying multi-page rubrics consistently across long evaluation batches. Clear written reasoning that names the issue and the standard being applied. Reliable async availability for at least 10 hours per week. Prior model-evaluation, annotation, or human-rater experience is a plus.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Chinese (China) Linguistic Expert — AI Evaluation
Chinese (China) Linguistic Expert — AI Evaluation

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Remote work
Flexible hours
Chinese (Taiwan) Linguistic Expert — AI Evaluation
Chinese (Taiwan) Linguistic Expert — AI Evaluation

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Chinese (Hong Kong SAR China) Linguistic Expert — AI Evaluation
Chinese (Hong Kong SAR China) Linguistic Expert — AI Evaluation

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Traditional Chinese Linguistic Expert — AI Evaluation and Review
Traditional Chinese Linguistic Expert — AI Evaluation and Review

AuraOne Human Data • United States

Remote
USD 50,000 - 61,000
Simplified Chinese Linguistic Expert
Simplified Chinese Linguistic Expert

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Remote work
Independent contractor
Remote Mandarin AI Evaluation & Annotation Specialist
Remote Mandarin AI Evaluation & Annotation Specialist

AuraOne Human Data • United States

Remote
USD 34,000 - 62,000
Consulting Expert, Mandarin Chinese (mainland China)
Consulting Expert, Mandarin Chinese (mainland China)

Auraone • United States

Remote
USD 68,000 - 97,000
Human Resources Expert, Mandarin Chinese (mainland China)
Human Resources Expert, Mandarin Chinese (mainland China)

Auraone • United States

Remote
USD 69,000 - 96,000
Chinese Linguistic Experts
Chinese Linguistic Experts

AuraOne Human Data • United States

Remote
USD 57,000 - 81,000
Human Resources Expert, Mandarin Chinese (mainland China)
Human Resources Expert, Mandarin Chinese (mainland China)

AuraOne, Inc. • United States

Remote
USD 83,000 - 96,000