MSR Project – Japanese Culture Expert

Welo Global; United States; Remote; USD 48,000 - 80,000; Full time

Job summary

Jobicy seeks Japanese-speaking experts for a language evaluation project. You will identify when AI responses fail on search tasks, craft queries, test results, and write evaluation criteria. The role emphasizes hands-on testing, local knowledge, and precise documentation.

Start ASAP for an ongoing freelance assignment with remote work in Japan. Ideal candidates have strong research and writing skills, keen attention to detail, and the ability to iterate through tests to identify region-specific

Qualifications

• Research skills to verify information from multiple sources.
• Critical thinking to spot contradictions and outdated info.
• Attention to detail for local variations and edge cases.
• Problem-solving mindset with iterative testing.
• Domain knowledge in research, QA, compliance or related field.
• Writing clarity to articulate instructions and rubrics.
• Locale knowledge of Japan to spot region-specific failures.

Responsibilities

• Identify realistic search-related failures in AI responses.
• Create search queries, test them, document failures.
• Write instructions and evaluation rubrics for correct answers.
• Assess local relevance, source quality, and language mismatches.

Skills

Research skills

Critical thinking

Attention to detail

Problem solving

Domain knowledge

Writing clarity

Locale knowledge

Job description

Overview

Are you passionate about languages, writing, and quality evaluation? We are launching an exciting language evaluation project and are looking for Japanese-speaking experts to join our team.

What you will do:

Identify realistic search-related failures where an AI model provides inadequate responses. Create search queries, test them, document what went wrong, and write instructions and evaluation criteria for correct answers.

Common issues: local relevance, source quality, outdated information, language mismatches, incomplete answers, and region-specific inapplicability. Testing multiple queries before finding failures is expected.

This is a practical, execution-focused role. We value hands‑on performance and consistency over advanced academic training. Candidates who prefer theoretical/research work may not find this role a good fit.

Project Details:

• Start Date: ASAP
• Duration: Ongoing Project.
• Commitment: 20/hours week.
• Job Type: Freelance contract.
• Location: Japan, Remote
• Rate: $35-57.75 per hour.

Requirements:

• Research skills — ability to find and verify information from multiple sources; comfort navigating different websites, databases, and documentation
• Critical thinking — Can spot contradictions between sources, identify outdated information, and recognize when something doesn’t apply to a specific locale/context
• Attention to detail — Can catch nuances in language, local variations (prices, regulations, requirements), and edge cases
• Problem-solving mindset — Comfortable iterating and testing when things don’t work; doesn’t get frustrated by trial-and-error
• Domain knowledge — Ideally someone with background in research, quality assurance, compliance, or similar work that requires precision and source verification
• Writing clarity — Can articulate instructions and rubrics clearly so others understand the logic behind their reasoning
• Locale knowledge — Deep familiarity with their specific locale (local regulations, business practices, cultural nuances) is valuable for spotting region-specific failures