Hindi QA & Language Researcher - Remote

Remote; San Francisco (CA); Remote; USD 11,000 - 16,000; Part time

Job summary

Remote is seeking Hindi-speaking experts to join an exciting language evaluation project. You will identify failures in AI responses, craft test queries, and document findings with clear evaluation criteria.

The role is a freelance contract with a commitment of 20 hours per week, conducted remotely from India, at a rate of $10 per hour. The project emphasizes language accuracy, regional relevance, and precise source verification.

Qualifications

• Research and verify information from multiple sources.
• Spot contradictions between sources and identify outdated information.
• Notice language nuances and regional differences.
• Iterate and test when things don’t work.
• Background in research, QA, compliance is a plus.
• Articulate instructions and rubrics clearly.
• Strong familiarity with locale-specific regulations and practices.

Responsibilities

• Identify realistic search-related failures where an AI model provides inadequate responses.
• Create search queries, test them, and document what went wrong.
• Write instructions and evaluation criteria for correct answers.

Skills

Research skills

Critical thinking

Attention to detail

Problem solving

Domain knowledge

Writing clarity

Locale knowledge

Job description

Remote is seeking Hindi-speaking experts to join an exciting language evaluation project. You will identify failures in AI responses, craft test queries, and document findings with clear evaluation criteria.

The role is a freelance contract with a commitment of 20 hours per week, conducted remotely from India, at a rate of $10 per hour. The project emphasizes language accuracy, regional relevance, and precise source verification.