Remote Bilingual Chinese AI Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 34,000 - 69,000; Full time

Job summary

AuraOne is seeking a Bilingual Chinese AI Evaluation Specialist for a remote, contractor role. You will review chinese generalist evaluation prompts and responses, score against a quality rubric, and provide structured feedback for model retraining.

Responsibilities include comparing outputs, labeling edge cases, and calibrating reviewer scores weekly. Remote US-eligible, hourly rate paid after interview, with program-defined task pacing.

Qualifications

• Prior evaluation, annotation, or human‑rater experience on chinese generalist evaluation or adjacent content.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning that names the issue and rubric clause applied.

Responsibilities

• Evaluate chinese generalist evaluation model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them for rubric updates.
• Maintain reviewer quality scores by calibrating against gold‑standard examples weekly.

Skills

Bilingual Chinese

Evaluation experience

Annotation skills

Rubric labeling

Attention to detail

Job description

AuraOne is seeking a Bilingual Chinese AI Evaluation Specialist for a remote, contractor role. You will review chinese generalist evaluation prompts and responses, score against a quality rubric, and provide structured feedback for model retraining.

Responsibilities include comparing outputs, labeling edge cases, and calibrating reviewer scores weekly. Remote US-eligible, hourly rate paid after interview, with program-defined task pacing.