MSR Project - Japanese Culture Expert

OpenKrill; United States; A distancia; USD 69.000 - 80.000; Jornada completa

Descripción de la vacante

OpenKrill is seeking Japanese-speaking experts for a language evaluation project. You will identify failures in AI responses, craft search queries, test results, and draft precise evaluation criteria. This is a freelance, remote role centered in Japan with flexible weekly hours.

The ideal candidate holds a Master’s or Bachelor’s degree and has strong research and writing skills, plus a keen eye for locale-specific details and language nuances. Start date is ASAP, rate is $50.75–$57.75 per hour.

Formación

• Research skills to verify information from multiple sources.
• Critical thinking to spot contradictions and outdated data.
• Attention to language nuances and regional variations.
• Problem-solving mindset for iterative testing and learning.
• Domain knowledge from research, QA, or compliance fields.
• Clear writing to articulate instructions and rubrics.
• Familiarity with locale-specific regulations and practices.

Responsabilidades

• Identify realistic search-related failures where AI responses are inadequate.
• Create targeted search queries and test them thoroughly.
• Document failures with evidence and context for each case.
• Write instructions and evaluation criteria for correct answers.
• Collaborate with the team to refine evaluation rubrics.

Conocimientos

Research skills

Critical thinking

Attention to detail

Problem-solving

Domain knowledge

Writing clarity

Locale knowledge

Educación

Masters and Bachelor's degrees preferred

Descripción del empleo

Overview

Are you passionate about languages, writing, and quality evaluation? We are launching an exciting language evaluation project and are looking for Japanese-speaking experts to join our team.

What you will do:

Identify realistic search-related failures where an AI model provides inadequate responses. Create search queries, test them, document what went wrong, and write instructions and evaluation criteria for correct answers.

Common issues: local relevance, source quality, outdated information, language mismatches, incomplete answers, and region-specific inapplicability. Testing multiple queries before finding failures is expected.

Project Details:

• Start Date: ASAP
• Duration: Ongoing Project.
• Commitment: 20/hours week.
• Job Type: Freelance contract.
• Location: Japan, Remote
• Rate: $50.75-57.75 per hour.
• Master's and bachelor's degree holders are preferred for this position.

Requirements:

• Research skills - ability to find and verify information from multiple sources; comfort navigating different websites, databases, and documentation
• Critical thinking - Can spot contradictions between sources, identify outdated information, and recognize when something doesn't apply to a specific locale/context
• Attention to detail - Can catch nuances in language, local variations (prices, regulations, requirements), and edge cases
• Problem-solving mindset - Comfortable iterating and testing when things don't work; doesn't get frustrated by trial-and-error
• Domain knowledge - Ideally someone with background in research, quality assurance, compliance, or similar work that requires precision and source verification
• Writing clarity - Can articulate instructions and rubrics clearly so others understand the logic behind their reasoning
• Locale knowledge - Deep familiarity with their specific locale (local regulations, business practices, cultural nuances) is valuable for spotting region-specific failures