Moonlight MCQA - Chinese (Simplified) Generalist

AuraOne; United States; On-site; USD 55,000 - 68,000; Full time

Benefits offered by this job

Remote work

Contractor arrangement

Job summary

AI Trainer Jobs is seeking a remote, independent contractor to evaluate Chinese model outputs for Moonlight MCQA - Chinese (Simplified) Generalist. You will assess fluency, register, and cultural fit, and write structured rationale for the modeling team.

Applicants should show native-level Chinese and strong English writing, experience in editing or translating Chinese content, and the ability to apply rubrics consistently across large batches. Remote, contract-based with flexible hours.

Qualifications

• Native or near-native Chinese fluency with strong written-English ability.
• Demonstrable experience editing, translating, or evaluating Chinese content.
• Comfort applying multi-page rubrics consistently across long evaluation batches.
• Clear written reasoning that names the issue and the standard being applied.

Responsibilities

• Evaluate Chinese model responses for fluency, accuracy, register, and cultural fit.
• Compare paired Chinese evaluation outputs and pick the stronger response with a written rationale.
• Flag hallucinations, code-switching errors, and formality mismatches with task-specific severity tags.
• Capture native-speaker edits that demonstrate the correct phrasing alongside each issue.

Skills

Native Chinese fluency

Strong written English

Async availability

Editing/translating Chinese content

Tools

TMS tools

MQM error taxonomies

LLM evaluation rubrics

Job description

About the role

Moonlight MCQA - Chinese (Simplified) Generalist is a remote Chinese specialist track for evaluating chinese evaluation outputs against native-speaker standards. Reviewers spot fluency, register, and cultural-context errors that automated checks miss, and write structured rationale that the modeling team can act on in the next training cycle.
Multilingual model quality depends on reviewers who can read Chinese the way a native speaker does. AuraOne uses these reviewers to set the bar for tone, formality, and cultural register before a model ever ships to Chinese users.
Review translation and localization work. Dialect and cultural context matter here.

Responsibilities

• Evaluate Chinese model responses for fluency, accuracy, register, and cultural fit for Moonlight MCQA - Chinese (Simplified) Generalist assignments.
• Compare paired chinese evaluation outputs and pick the stronger response with a written rationale.
• Flag hallucinations, code-switching errors, and formality mismatches with task-specific severity tags.
• Capture native-speaker edits that demonstrate the correct phrasing alongside each issue.

Role details

Track Language evaluation Work model Remote · Independent specialist contractor Compensation $40–$49 / hr Eligible from US

What you should bring

• Native or near-native Chinese fluency with strong written-English ability for Moonlight MCQA - Chinese (Simplified) Generalist work.
• Demonstrable experience editing, translating, or evaluating Chinese content.
• Comfort applying multi-page rubrics consistently across long evaluation batches.
• Clear written reasoning that names the issue and the standard being applied.
• Reliable async availability for at least 10 hours per week.
• Prior model-evaluation, annotation, or human-rater experience is a plus.

Role signals

• Score a pair of Chinese responses to a customer-support prompt and pick the better one with a 1-2 sentence rationale.
• Flag formality mismatches in chinese evaluation outputs (T/V usage, honorifics, regional register).
• Rewrite a model's Chinese response so it reads naturally and tag the original error category.
• Audit a 50-row evaluation batch for rubric consistency and surface drift back to the program lead.

Useful experience

• Background in Chinese linguistics, journalism, or translation studies.
• Experience with TMS tools, MQM error taxonomies, or other structured QA frameworks.
• Familiarity with LLM evaluation rubrics and inter-rater agreement workflows.

Compensation and schedule

$40–$49 / hr
Expected arrangement: contractor , with program-defined task volume and review pacing. Placement depends on current program demand and reviewer confirmation.

Skills used in matching

• Multilingual evaluation
• Native-speaker review
• Rubric application
• LLM output evaluation
• Chinese evaluation