Remote Bilingual Chinese AI Evaluation Specialist

AuraOne; United States; On-site; USD 34,440 - 41,328; Part time

Job summary

AuraOne is seeking a remote, contractor AI Evaluation Specialist focused on Bilingual Simplified Chinese. You will compare and rate Chinese outputs, flag issues, and provide native-speaker edits with clear rationales to improve future model training cycles.

Responsibilities include evaluating fluency, accuracy, and cultural fit, and maintaining notes on idioms and regional variations for ongoing rubric refinement. Requires strong Chinese skills and reliable weekly availability.

Qualifications

• Native or near-native Chinese fluency with strong written-English ability.
• Demonstrable experience editing, translating, or evaluating Chinese content.
• Comfort applying multi-page rubrics consistently across long evaluation batches.
• Clear written reasoning that names the issue and the standard being applied.

Responsibilities

• Evaluate Chinese model responses for fluency, accuracy, register, and cultural fit.
• Compare paired Chinese evaluation outputs and pick the stronger response with a written rationale.
• Flag hallucinations, code-switching errors, and formality mismatches with task-specific severity tags.
• Capture native-speaker edits that demonstrate the correct phrasing alongside each issue.
• Calibrate against the AuraOne Chinese rubric in weekly reviewer-quality cycles.
• Surface ambiguous prompts back to the program team so the rubric can be sharpened.
• Maintain reviewer notes that document tricky idioms, regionalisms, and emerging usage.

Skills

Multilingual evaluation

Native-speaker review

Rubric application

LLM output evaluation

Chinese evaluation

Job description

AuraOne is seeking a remote, contractor AI Evaluation Specialist focused on Bilingual Simplified Chinese. You will compare and rate Chinese outputs, flag issues, and provide native-speaker edits with clear rationales to improve future model training cycles.

Responsibilities include evaluating fluency, accuracy, and cultural fit, and maintaining notes on idioms and regional variations for ongoing rubric refinement. Requires strong Chinese skills and reliable weekly availability.