MSR Project - Hindi Culture Expert

OpenKrill; United States; Remote; USD 12,000 - 17,000; Part time

Job summary

OpenKrill is seeking Hindi-speaking experts for an exciting language evaluation project. This freelance role requires about 20 hours per week and is remote from India, at a rate of $10 per hour. Start date is ASAP.

You will identify search-related failures in AI responses, create tests, document issues, and write evaluation rubrics to guide correct answers. Strong research and writing skills are essential.

Qualifications

• Research skills to find and verify information across multiple sources.
• Critical thinking to spot contradictions, outdated info, and locale applicability.
• Attention to detail to catch language nuances and regional variations.
• Problem-solving mindset for iterative testing and improvements.
• Domain knowledge in research/QA/compliance aids accuracy.
• Writing clarity to articulate instructions and rubrics clearly.
• Locale knowledge to spot region-specific failures and practices.

Responsibilities

• Identify realistic search-related failures where an AI model provides inadequate responses.
• Create targeted search queries, test them, and document what went wrong.
• Write instructions and evaluation criteria for correct answers.
• Iterate and refine failure scenarios based on results and sources.

Skills

Research skills

Critical thinking

Attention to detail

Problem-solving

Domain knowledge

Writing clarity

Locale knowledge

Job description

Overview

Are you passionate about languages, writing, and quality evaluation? We are launching an exciting language evaluation project and are looking for Hindi-speaking experts to join our team.

What you will do:

Identify realistic search-related failures where an AI model provides inadequate responses. Create search queries, test them, document what went wrong, and write instructions and evaluation criteria for correct answers.

Common issues:

local relevance, source quality, outdated information, language mismatches, incomplete answers, and region-specific inapplicability. Testing multiple queries before finding failures is expected.

Project Details:

• Start Date: ASAP
• Duration: Ongoing Project.
• Commitment: 20 hours per week.
• Job Type: Freelance contract.
• Location: India, Remote
• Rate: $10 per hour.

Requirements:

• Research skills - ability to find and verify information from multiple sources; comfort navigating different websites, databases, and documentation
• Critical thinking - Can spot contradictions between sources, identify outdated information, and recognize when something doesn't apply to a specific locale/context
• Attention to detail - Can catch nuances in language, local variations (prices, regulations, requirements), and edge cases
• Problem-solving mindset - Comfortable iterating and testing when things don't work; doesn't get frustrated by trial-and-error
• Domain knowledge - Ideally someone with background in research, quality assurance, compliance, or similar work that requires precision and source verification
• Writing clarity - Can articulate instructions and rubrics clearly so others understand the logic behind their reasoning
• Locale knowledge - Deep familiarity with their specific locale (local regulations, business practices, cultural nuances) is valuable for spotting region-specific failures