MSR Project - Korean Culture Expert

Welocalize, Inc.; United States; Remote; USD 40,000 - 57,000; Part time

Benefits offered by this job

Remote work

Job summary

Welocalize, Inc. seeks Korean-speaking experts to join a language evaluation project focused on identifying AI output failures related to locale and language nuances. You will search, verify sources, and document evaluation criteria for correct answers.

Remote freelance role with flexible hours; start ASAP; expected commitment around 20 hours per week, rate $35 per hour. Prior research or QA background is helpful.

Qualifications

• Research abilities to locate and verify information across multiple sources.
• Critical thinking to spot contradictions and outdated data.
• Attention to language nuances and locale-specific variations.
• Problem-solving mindset with iterative testing.
• Experience in research, QA, or compliance is preferred.

Responsibilities

• Identify realistic search-related failures in AI responses.
• Create and test search queries to provoke failures.
• Document issues and evaluate root causes.
• Develop instructions and rubrics for correct answers.

Skills

Research skills

Critical thinking

Attention to detail

Problem solving

Domain knowledge

Writing clarity

Locale knowledge

Job description

Location: South Korea

Overview

Areyoupassionateaboutlanguages,writing,andqualityevaluation?WearelaunchinganexcitinglanguageevaluationprojectandarelookingforKorean-speakingexpertstojoinourteam.

Whatyouwilldo:

Identifyrealisticsearch-relatedfailureswhereanAImodelprovidesinadequateresponses.Createsearchqueries,testthem,documentwhatwentwrong,andwriteinstructionsandevaluationcriteriaforcorrectanswers.

Commonissues:

localrelevance,sourcequality,outdatedinformation,languagemismatches,incompleteanswers,andregion-specificinapplicability.Testingmultiplequeriesbeforefindingfailuresisexpected.

ProjectDetails:

• Start Date: ASAP
• Duration:OngoingProject.
• Commitment:20hoursperweek.
• JobType:Freelancecontract.
• Location:Remote,Korea
• Rate:$35perhour.

Requirements:

• Research skills — ability to find and verify information from multiple sources; comfort navigating different websites, databases, and documentation
• Critical thinking — Can spot contradictions between sources, identify outdated information, and recognize when something doesn't apply to a specific locale/context
• Attention to detail — Can catch nuances in language, local variations (prices, regulations, requirements), and edge cases
• Problem-solving mindset — Comfortable iterating and testing when things don't work; doesn't get frustrated by trial-and-error
• Domain knowledge — Ideally someone with background in research, quality assurance, compliance, or similar work that requires precision and source verification
• Writing clarity — Can articulate instructions and rubrics clearly so others understand the logic behind their reasoning
• Locale knowledge — Deep familiarity with their specific locale (local regulations, business practices, cultural nuances) is valuable for spotting region-specific failures