MSR Project - Hindi Culture Expert

Welocalize, Inc.; United States; Remote; USD 14,000 - 17,000; Part time

Job summary

Welocalize, Inc. is seeking Hindi-speaking experts to join an exciting language-evaluation project. You will test AI model responses, craft search queries, and document failures with clear instructions and evaluation criteria.

Start ASAP, 20 hours per week on a freelance contract. Location: India, remote. The rate is $10 per hour. Ideal candidates have strong research ability, critical thinking, attention to detail, and deep locale knowledge to ensure accurate regional evaluation.

Qualifications

• Research skills with ability to verify information from multiple sources.
• Critical thinking to spot contradictions and outdated information.
• Attention to detail to catch linguistic nuances and regional variations.
• Problem solving mindset to iterate when needed.
• Domain knowledge in research, QA, compliance, or similar work.
• Clear writing to articulate instructions and rubrics.
• Locale knowledge for spotting region-specific failures.

Responsibilities

• Identify realistic search-related failures where an AI model provides inadequate responses.
• Create and test search queries, document outcomes, and write evaluation criteria for correct answers.

Skills

Research skills

Critical thinking

Attention to detail

Problem solving

Domain knowledge

Writing clarity

Locale knowledge

Job description

Location: India

Overview

Areyoupassionateaboutlanguages,writing,andqualityevaluation?WearelaunchinganexcitinglanguageevaluationprojectandarelookingforHindi-speakingexpertstojoinourteam.

What you will do

Identifyrealisticsearch-relatedfailureswhereanAImodelprovidesinadequateresponses.Createsearchqueries,testthem,documentwhatwentwrong,andwriteinstructionsandevaluationcriteriaforcorrectanswers.

Common issues

Commonissues:localrelevance,sourcequality,outdatedinformation,languagemismatches,incompleteanswers,andregion-specificinapplicability.Testingmultiplequeriesbeforefindingfailuresisexpected.

Project Details

• - Start Date: ASAP
• - Duration:OngoingProject.
• - Commitment:20hoursperweek.
• - JobType:Freelancecontract.
• - Location:India,Remote
• - Rate:$10perhour.

Requirements

• - Research skills — ability to find and verify information from multiple sources; comfort navigating different websites, databases, and documentation
• - Critical thinking — Can spot contradictions between sources, identify outdated information, and recognize when something doesn't apply to a specific locale/context
• - Attention to detail — Can catch nuances in language, local variations (prices, regulations, requirements), and edge cases
• - Problem-solving mindset — Comfortable iterating and testing when things don't work; doesn't get frustrated by trial-and-error
• - Domain knowledge — Ideally someone with background in research, quality assurance, compliance, or similar work that requires precision and source verification
• - Writing clarity — Can articulate instructions and rubrics clearly so others understand the logic behind their reasoning
• - Locale knowledge — Deep familiarity with their specific locale (local regulations, business practices, cultural nuances) is valuable for spotting region-specific failures