Remote Language QA Researcher — Spanish Evaluations

OpenKrill; United States; Remote; USD 34,000 - 48,000; Part time

Job summary

OpenKrill is seeking Spanish-speaking experts to join an exciting language evaluation project. You will identify failures in AI responses, craft search queries, test scenarios, and document results with clear rubrics.

This freelance role offers remote work, a commitment of 20 hours per week, and a competitive rate of $30 per hour. Start date ASAP, ongoing project with flexible scheduling for qualified researchers.

Qualifications

• Research skills to find and verify information from multiple sources.
• Critical thinking to spot contradictions and outdated information.
• Attention to detail for language nuances and regional variations.
• Problem-solving mindset for iterative testing.
• Domain knowledge from research, QA, compliance, or similar roles.
• Writing clarity to articulate instructions and rubrics.
• Locale knowledge of specific locale and cultural nuances.

Responsibilities

• Identify realistic search-related failures where AI responses are inadequate.
• Create search queries, test them, document failures, and write instructions and evaluation criteria for correct answers.
• Test multiple queries before identifying failures.

Skills

Research skills

Critical thinking

Attention to detail

Problem-solving mindset

Domain knowledge

Writing clarity

Locale knowledge

Job description

OpenKrill is seeking Spanish-speaking experts to join an exciting language evaluation project. You will identify failures in AI responses, craft search queries, test scenarios, and document results with clear rubrics.

This freelance role offers remote work, a commitment of 20 hours per week, and a competitive rate of $30 per hour. Start date ASAP, ongoing project with flexible scheduling for qualified researchers.