Remote Hindi Language QA & Evaluation Specialist

OpenKrill; United States; Remote; USD 12,000 - 17,000; Part time

Job summary

OpenKrill is seeking Hindi-speaking experts for an exciting language evaluation project. This freelance role requires about 20 hours per week and is remote from India, at a rate of $10 per hour. Start date is ASAP.

You will identify search-related failures in AI responses, create tests, document issues, and write evaluation rubrics to guide correct answers. Strong research and writing skills are essential.

Qualifications

• Research skills to find and verify information across multiple sources.
• Critical thinking to spot contradictions, outdated info, and locale applicability.
• Attention to detail to catch language nuances and regional variations.
• Problem-solving mindset for iterative testing and improvements.
• Domain knowledge in research/QA/compliance aids accuracy.
• Writing clarity to articulate instructions and rubrics clearly.
• Locale knowledge to spot region-specific failures and practices.

Responsibilities

• Identify realistic search-related failures where an AI model provides inadequate responses.
• Create targeted search queries, test them, and document what went wrong.
• Write instructions and evaluation criteria for correct answers.
• Iterate and refine failure scenarios based on results and sources.

Skills

Research skills

Critical thinking

Attention to detail

Problem-solving

Domain knowledge

Writing clarity

Locale knowledge

Job description

OpenKrill is seeking Hindi-speaking experts for an exciting language evaluation project. This freelance role requires about 20 hours per week and is remote from India, at a rate of $10 per hour. Start date is ASAP.

You will identify search-related failures in AI responses, create tests, document issues, and write evaluation rubrics to guide correct answers. Strong research and writing skills are essential.