LLM - AI Quality Analyst (Chinese) | $11/hr - Remote

Crossing Hurdles; India; Remote; INR 2,637,000 - 4,746,000; Part time

Job summary

A tech-focused company is seeking a skilled LLM – AI Quality Analyst with proficiency in Chinese to evaluate personalized AI responses. You will design prompts, assess relevance, and ensure data hygiene while working remotely. Strong experience in data annotation or a related field is required, alongside a BS/BA degree or equivalent. This short-term contract requires 30–40 hours per week with an immediate start date.

Qualifications

• Fluency in reading and writing Chinese is mandatory.
• Proven experience in data annotation or AI quality evaluation is required.
• Strong analytical skills and attention to detail are essential.
• Ability to evaluate nuanced AI responses.
• Familiarity with using a personal Google account for data sources.
• BS/BA or equivalent experience in a relevant analytical field.
• Strong written communication and structured feedback skills.
• Self-motivated, able to work remotely.

Responsibilities

• Design conversational prompts based on personal context.
• Evaluate AI responses for relevance and helpfulness.
• Perform side-by-side evaluation and ranking of AI responses.
• Perform side-by-side evaluation and ranking of AI responses.
• Identify grounding errors and misinferences.
• Write structured rationales referencing conversation turns.
• Extract and verify model debug information and data source usage.
• Maintain data hygiene by deleting evaluation conversations.

Skills

Chinese fluency (reading and writing)

Strong analytical thinking

Attention to detail

Ability to evaluate nuanced AI responses

Strong written communication

Attention to detail

Structured feedback

Remote work

Education

BS/BA degree or equivalent experience in a relevant analytical field

Job description

Position: LLM – AI Quality Analyst (Personalization) – Chinese

Type: Short-Term Contract

Location: Remote

Commitment: 30–40 hours/week, 4-hour overlap with PST

Engagement Length: 2 months

Start Date: Immediate

Role Responsibilities

• Design multi-turn conversational prompts based on personal context
• Evaluate personalized AI responses for relevance, grounding, and helpfulness
• Assess correct and incorrect use of personal data in model outputs
• Perform side-by-side (SxS) evaluation and ranking of AI responses
• Identify grounding errors, poor inferences, and forced personalization
• Write clear, structured rationales referencing specific conversation turns
• Extract and verify model debug information and data source usage
• Maintain strict data hygiene by deleting evaluation conversations

Requirements

• Chinese fluency (reading and writing)
• Strong experience in data annotation, AI quality evaluation, content moderation, or related roles
• Strong analytical thinking and attention to detail
• Ability to evaluate nuanced and ambiguous AI responses
• Comfortable using a primary personal Google account with enabled data sources
• BS/BA degree or equivalent experience in a relevant analytical field
• Strong written communication and structured feedback skills
• Self-motivated and able to work independently in a remote setting
• Reliable desktop/laptop with stable internet connection