Data Analyst (Chinese) | $20/hr Remote

Crossing Hurdles; Malaysia; On-site; MYR 83,000 - 111,000; Part time

Job summary

Crossing Hurdles seeks a Remote LLM AI Quality Analyst (Chinese) for a 4-month contractor assignment. You will design and evaluate multi-turn prompts, ensuring personalization quality, grounding, and overall helpfulness of AI responses.

Strong Chinese writing and analytical skills are essential, with experience in AI evaluation or data annotation preferred. The role requires up to 40 hours per week, with 4 hours overlap with PST, and compensation of $15–$20 per hour.

Qualifications

• Strong Chinese language proficiency, including reading and writing.
• Experience in AI evaluation, data annotation, content moderation, or related analytical roles is preferred.
• Strong analytical and critical-thinking skills with ability to evaluate nuanced AI responses.
• Experience designing creative, multi-turn prompts and assessing personalization quality.
• Excellent written communication and ability to provide clear, evidence-based evaluation rationales.

Responsibilities

• Design and execute multi-turn prompts using personal context and experiences.
• Evaluate AI responses for personalization, grounding, integration, and helpfulness.
• Compare and rank AI-generated responses side-by-side based on quality and relevance.
• Identify incorrect personalization, unsupported inferences, hallucinations, and unnatural responses.
• Provide clear, structured rationales and detailed feedback on model performance.
• Review data usage and maintain proper evaluation and data hygiene.

Skills

Chinese proficiency

Analytical thinking

Prompt design

AI evaluation

Job description

Position: LLM - AI Quality Analyst (Chinese)

Type: Short-Term Contractor Assignment (4 months)

Compensation: $15 - $20 per hour

Location: Remote

Commitment: Up to 40 hours per week with 4 hours overlap with PST

Role Responsibilities

• Design and execute multi-turn prompts using personal context and experiences.
• Evaluate AI responses for personalization, grounding, integration, and helpfulness.
• Compare and rank AI-generated responses side-by-side based on quality and relevance.
• Identify incorrect personalization, unsupported inferences, hallucinations, and unnatural responses.
• Provide clear, structured rationales and detailed feedback on model performance.
• Review data usage and maintain proper evaluation and data hygiene.

Requirements

• Strong Chinese language proficiency, including reading and writing.
• Experience in AI evaluation, data annotation, content moderation, or a related analytical role is preferred.
• Strong analytical and critical-thinking skills with the ability to evaluate nuanced AI responses.
• Experience designing creative, multi-turn prompts and assessing personalization quality.
• Excellent written communication and ability to provide clear, evidence-based evaluation rationales.
• Active user of a personal Google account and willing to enable required personal data sources.