Chinese Culture Expert

Welo Data; United States; Remote; USD 36,000 - 40,000; Part time

Job summary

Welo Data is launching a language-evaluation project and seeks Chinese-speaking experts to join the team. You will identify real-world failures where AI responses miss the mark, test queries, document findings, and craft clear instructions and rubrics for correct answers.

Responsibilities include collecting diverse sources, verifying information, and applying locale knowledge to spot region-specific issues while maintaining high accuracy and precise reporting.

Qualifications

• Research skills and ability to verify information from multiple sources.
• Critical thinking to spot outdated information and locale-specific issues.
• Attention to detail to catch language nuances and regional variations.
• Problem-solving mindset for iterative testing and refinement.
• Domain knowledge in research, QA, or compliance preferred.
• Writing clarity to articulate instructions and rubrics clearly.
• Deep familiarity with locale regulations and business practices.

Responsibilities

• Identify realistic search-related failures where an AI model provides inadequate responses.
• Create search queries, test them, document what went wrong, and write instructions and evaluation criteria for correct answers.
• Note common issues: local relevance, source quality, outdated information, language mismatches, incomplete answers, region-specific inapplicability.
• Test multiple queries before finding failures.

Skills

Research skills

Critical thinking

Attention to detail

Problem-solving

Domain knowledge

Writing clarity

Locale knowledge

Job description

Overview

Areyoupassionateaboutlanguages,writing,andqualityevaluation?WearelaunchinganexcitinglanguageevaluationprojectandarelookingforChinese-speakingexpertstojoinourteam.

Whatyouwilldo:

Identifyrealisticsearch-relatedfailureswhereanAImodelprovidesinadequateresponses.Createsearchqueries,testthem,documentwhatwentwrong,andwriteinstructionsandevaluationcriteriaforcorrectanswers.

Commonissues:localrelevance,sourcequality,outdatedinformation,languagemismatches,incompleteanswers,andregion-specificinapplicability.Testingmultiplequeriesbeforefindingfailuresisexpected.

ProjectDetails:

• - Start Date: ASAP
• - Duration:OngoingProject.
• - Commitment:20hoursperweek.
• - JobType:Freelancecontract.
• - Location:Remote,Australia
• - Rate:$40perhour.

Requirements:

• - Research skills — ability to find and verify information from multiple sources; comfort navigating different websites, databases, and documentation
• - Critical thinking — Can spot contradictions between sources, identify outdated information and recognize when something doesn't apply to a specific locale/context
• - Attention to detail — Can catch nuances in language, local variations (prices, regulations, requirements, and edge cases
• - Problem-solving mindset — Comfortable iterating and testing when things don't work; doesn't get frustrated by trial- and-error
• - Domain knowledge — Ideally someone with background in research, quality assurance, compliance, or similar work that requires precision and source verification
• - Writing clarity — Can articulate instructions and rubrics clear so others understand the logic behind their reasoning
• Locale knowledge — Deep familiarity with their specific locale (local regulations, business practices, cultural nuances) is valuable for spotting region‑specific failures