Chinese Culture Expert

Welo Data; Melbourne; Remote; AUD 40,000 - 52,000; Part time

Job summary

Welo Data in Australia seeks Chinese-speaking experts for an ongoing language evaluation project. You will identify failures in AI responses, craft test queries, verify results, and write clear instructions and rubrics for correct answers.

Requirements include strong research skills, critical thinking, attention to detail, and locale knowledge to handle region-specific nuances. This is a remote freelance contract with $40/hour rate.

Qualifications

• Ability to find and verify information from multiple sources.
• Navigate websites, databases, and documentation to gather evidence.
• Spot contradictions between sources and identify outdated information.
• Respect locale context and regional variations when testing.
• Articulate clear instructions and rubrics for evaluation.

Responsibilities

• Identify realistic search-related failures where an AI model provides inadequate responses.
• Create search queries, test them, document what went wrong, and write evaluation criteria.
• Provide guidance and criteria for correct answers and future improvements.
• Test multiple queries to ensure robust coverage across locales.

Skills

Research skills

Critical thinking

Attention to detail

Problem-solving mindset

Domain knowledge

Writing clarity

Locale knowledge

Job description

Areyoupassionateaboutlanguages,writing,andqualityevaluation?WearelaunchinganexcitinglanguageevaluationprojectandarelookingforChinese-speakingexpertstojoinourteam.

Whatyouwilldo:

Identifyrealisticsearch-relatedfailureswhereanAImodelprovidesinadequateresponses.Createsearchqueries,testthem,documentwhatwentwrong,andwriteinstructionsandevaluationcriteriaforcorrectanswers.

Commonissues:localrelevance,sourcequality,outdatedinformation,languagemismatches,incompleteanswers,andregion-specificinapplicability.Testingmultiplequeriesbeforefindingfailuresisexpected.

ProjectDetails:

• - Start Date: ASAP
• - Duration:OngoingProject.
• - JobType:Freelancecontract.
• - Location:Remote,Australia
• - Rate:$40perhour.

Requirements:

• - Research skills — ability to find and verify information from multiple sources; comfort navigating different websites, databases, and documentation
• - Critical thinking — Can spot contradictions between sources, identify outdated information, and recognize when something doesn't apply to a specific locale/context
• - Attention to detail — Can catch nuances in language, local variations (prices, regulations, requirements), and edge cases
• - Problem-solving mindset — Comfortable iterating and testing when things don't work; doesn't get frustrated by trial- and-error
• - Domain knowledge — Ideally someone with background in research, quality assurance, compliance, or similar work that requires precision and source verification
• - Writing clarity — Can articulate instructions and rubrics clearly so others understand the logic behind their reasoning
• Locale knowledge — Deep familiarity with their specific locale (local regulations, business practices, cultural nuances) is valuable for spotting region-specific failures