LLM AI Quality Analyst- Chinese Mandatory

Donato Technologies, Inc.; United States; Remote; USD 34,000 - 55,000; Part time

Job summary

Donato Technologies, Inc. is seeking a Chinese-speaking AI Quality Analyst (Personalization) for a four-month remote assignment in the United States.

You will evaluate personalized AI responses, create context-driven prompts, and identify issues like inaccuracies or hallucinations, providing clear rationales and detailed feedback. The role requires strong Chinese language skills, sharp analytical thinking, and excellent written communication.

Qualifications

• Strong Chinese reading and writing skills.
• Excellent analytical and critical-thinking skills.
• Strong written communication.
• Experience in AI evaluation, data annotation, content moderation, linguistics, research, or a related area is preferred.

Responsibilities

• Evaluate personalized AI responses and determine quality.
• Create multi-turn prompts based on personal experiences and context.
• Review AI responses for accuracy, helpfulness, and personalization.
• Identify incorrect personalization, unsupported assumptions, and hallucinations.
• Compare AI responses side-by-side and provide detailed feedback.
• Write clear rationales explaining evaluations.

Skills

Chinese reading and writing

Analytical thinking

Written communication

Education

Bachelor's degree or equivalent experience

Job description

Hiring: LLM – AI Quality Analyst (Personalization) – Chinese

We are looking for Chinese-speaking AI Quality Analysts to support a short-term AI evaluation project with a leading AI technology company.

Locations: USA
USA sourcing: Please do not source from Texas or Illinois
Duration: 4 months
Schedule: 30 or 40 hours/week | Minimum 4 hours/day
Time-zone requirement: 4 hours overlap with PST
Remote | Immediate Start

What You'll Do

• Evaluate personalized AI responses and determine their quality
  
• Create multi-turn prompts based on personal experiences and context
  
• Review AI responses for accuracy, helpfulness, and appropriate personalization
  
• Identify incorrect personalization, unsupported assumptions, and hallucinations
  
• Compare AI responses side-by-side and provide detailed feedback
  
• Write clear rationales explaining your evaluations

Requirements

• Strong Chinese reading and writing skills
• Excellent analytical and critical-thinking skills
• Strong written communication
• Experience in AI evaluation, data annotation, content moderation, linguistics, research, or a related area is preferred
• Bachelor's degree or equivalent experience
• Comfortable working independently in a remote environment
• Laptop/desktop with reliable internet
• Willingness to use a primary personal Google account and enable relevant personal data sources for the evaluation

Student-friendly opportunity: This may be a good fit for students or recent graduates who have strong Chinese language skills and are interested in AI, language, data annotation, content evaluation, or technology and can meet the required weekly schedule.

Selection Process

1. Job Interest Form
2. Profile review
3. Online assessment — must be completed within 24 hours
4. Pre-onboarding discussion

Interested candidates: Please send your updated resume and confirm:

• Chinese proficiency
• Current location
• Availability (30 or 40 hrs/week)
• Earliest start date
• Confirmation that you can provide 4 hours of PST overlap

This is a remote position.