Remote Mandarin Writer - Traditional Taiwan Evaluations

AI Trainer Jobs; United States; Remote; USD 20,000 - 29,000; Full time

Job summary

AI Trainer Jobs is seeking a Bilingual Writer (Mandarin Chinese - Traditional, Taiwan) for a remote evaluation track. You will review prompts and responses, compare pairs, and provide structured feedback to retrain models. This contractor role emphasizes consistent rubric application and clear, actionable reasoning.

Responsibilities include tagging, calibration, and identifying edge cases. Remote-US eligible, about $18/hr, with flexible weekly hours to fit program pacing and demand.

Qualifications

• Prior evaluation, annotation, or human-rater experience on mandarin generalist evaluation or adjacent content.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning naming the issue and rubric clause applied.

Responsibilities

• Evaluate mandarin generalist evaluation model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them to the program team for rubric updates.

Skills

Mandarin evaluation

Bilingual review

Rubric annotation

Inter-rater calibration

Quality assessment

Job description

AI Trainer Jobs is seeking a Bilingual Writer (Mandarin Chinese - Traditional, Taiwan) for a remote evaluation track. You will review prompts and responses, compare pairs, and provide structured feedback to retrain models. This contractor role emphasizes consistent rubric application and clear, actionable reasoning.

Responsibilities include tagging, calibration, and identifying edge cases. Remote-US eligible, about $18/hr, with flexible weekly hours to fit program pacing and demand.