Remote AI Quality Analyst (Chinese) - Gemini

AuraOne Human Data

United States

Remote

USD 18,000 - 23,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AuraOne Human Data is seeking an AI Quality Analyst for Gemini (Chinese) who will work remotely evaluating Chinese generalist evaluation prompts and responses against AuraOne's quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to retrain models.

Ideal candidates have experience with rubric-based annotation, inter-rater calibration, and clear, reasoned justifications. This contractor role offers asynchronous, remote work with flexible hours.

Qualifications

  • Experience evaluating model outputs using rubrics.
  • Ability to apply rubric clauses to complex prompts.
  • Strong attention to detail and analytical thinking.

Responsibilities

  • Evaluate Chinese generalist evaluation model outputs against a rubric and assign severity tags.
  • Compare paired responses and select the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples weekly.
  • Document recurring failure modes for model training improvements.

Skills

Model output evaluation
Rubric-based annotation
Severity tagging
Inter-rater calibration
Chinese generalist evaluation
Business Analysis
Content Creation

Job description

AuraOne Human Data is seeking an AI Quality Analyst for Gemini (Chinese) who will work remotely evaluating Chinese generalist evaluation prompts and responses against AuraOne's quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to retrain models.

Ideal candidates have experience with rubric-based annotation, inter-rater calibration, and clear, reasoned justifications. This contractor role offers asynchronous, remote work with flexible hours.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Quality Analyst (Gemini) - Chinese
AI Quality Analyst (Gemini) - Chinese

AuraOne Human Data • United States

Remote
USD 18,000 - 23,000
Remote Chinese AI Evaluation Analyst
Remote Chinese AI Evaluation Analyst

AuraOne Human Data • United States

Remote
USD 28,000 - 55,000
Remote Chinese AI Evaluation Specialist
Remote Chinese AI Evaluation Specialist

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Remote AI Personalization Quality Analyst
Remote AI Personalization Quality Analyst

Turing • United States

Remote
USD 17,000 - 25,000
Competitive hourly rate
Remote AI Quality Analyst: Personalization Evaluation
Remote AI Quality Analyst: Personalization Evaluation

Turing • United States

Remote
USD 17,000 - 24,000
Remote AI Personalization Quality Analyst
Remote AI Personalization Quality Analyst

Turing • United States

Remote
USD 17,000 - 24,000
Remote AI Quality Evaluator - English Evaluation
Remote AI Quality Evaluator - English Evaluation

AuraOne, Inc. • United States

Remote
USD 34,000 - 55,000
Remote AI Personalization Quality Analyst
Remote AI Personalization Quality Analyst

Turing • United States

Remote
USD 23,000 - 32,000
Remote AI Personalization Quality Analyst
Remote AI Personalization Quality Analyst

Turing • United States

Remote
USD 17,000 - 24,000
Contractor
3 months engagement
Remote AI Personalization Quality Analyst (Contractor)
Remote AI Personalization Quality Analyst (Contractor)

Turing • United States

Remote
USD 23,000 - 32,000