MSR Project - Japanese Culture Expert

Welocalize, Inc.; United States; On-site; USD 78,000 - 110,000; Full time

Job summary

Welocalize, Inc. seeks Japanese-speaking experts to join a freelance language evaluation project. You will identify real-world search-related failures where an AI model falls short and write evaluation criteria and instructions for correct answers.

The position is remote in Japan with a start date ASAP. It requires 20 hours per week and accepts PhD applications only, paying $68.25 per hour for ongoing freelance work.

Qualifications

• Research skills to locate and verify information across multiple sources.
• Critical thinking to spot contradictions and outdated information.
• Attention to detail to catch regional nuances and locale specifics.
• Problem-solving mindset for iterative testing and debugging.
• Domain knowledge in research, QA, or compliance is desirable.

Responsibilities

• Identify realistic search-related failures where an AI model provides inadequate responses.
• Create and test search queries; document failures and provide evaluation criteria.
• Write clear instructions and rubrics for correct answers.

Skills

Research skills

Critical thinking

Attention to detail

Problem-solving mindset

Domain knowledge

Writing clarity

Locale knowledge

Education

PhD

Job description

Location: Japan

Overview

Areyoupassionateaboutlanguages,writing,andqualityevaluation?WearelaunchinganexcitinglanguageevaluationprojectandarelookingforJapanese-speakingexpertstojoinourteam.

Whatyouwilldo:

Identifyrealisticsearch-relatedfailureswhereanAImodelprovidesinadequateresponses.Createsearchqueries,testthem,documentwhatwentwrong,andwriteinstructionsandevaluationcriteriaforcorrectanswers.

Commonissues:

localrelevance,sourcequality,outdatedinformation,languagemismatches,incompleteanswers,andregion-specificinapplicability.Testingmultiplequeriesbeforefindingfailuresisexpected.

ProjectDetails:

• - Start Date: ASAP
• - Duration: Ongoing Project.
• - Commitment: 20/hours week.
• - JobType:Freelancecontract.
• - Location:Japan,Remote
• - Rate: $68.25 per hour.
• - ThispositioncurrentlyacceptsPhDapplicationsonly.

Requirements:

• - Research skills — ability to find and verify information from multiple sources; comfort navigating different websites, databases, and documentation
• - Critical thinking — Can spot contradictions between sources, identify outdated information, and recognize when something doesn't apply to a specific locale/context
• - Attention to detail — Can catch nuances in language, local variations (prices, regulations, requirements), and edge cases
• - Problem-solving mindset — Comfortable iterating and testing when things don't work; doesn't get frustrated by trial-and-error
• - Domain knowledge — Ideally someone with background in research, quality assurance, compliance, or similar work that requires precision and source verification
• - Writing clarity — Can articulate instructions and rubrics clearly so others understand the logic behind their reasoning
• - Locale knowledge — Deep familiarity with their specific locale (local regulations, business practices, cultural nuances) is valuable for spotting region-specific failures