Remote Language QA & Culture Evaluator

Openkrill; United States; Remote; USD 50,000 - 55,000; Part time

Job summary

Openkrill is launching a language evaluation project and seeks English-speaking experts to join as freelance contractors. You will identify AI response failures, craft queries, test results, and write evaluation criteria to guide improvements.

The role is remote (UK) with 20 hours per week, starting ASAP, at a rate of $38 per hour. Strong research, critical thinking, and precise writing are essential for success.

Qualifications

• Research skills to locate and verify information from multiple sources across websites, databases and docs.
• Critical thinking to spot contradictions and identify outdated information.
• Attention to detail to catch language nuances, local variations and edge cases.
• Problem-solving mindset to iterate and test when things don’t work; patient with trial-and-error.

Responsibilities

• Identify realistic search-related failures where an AI model provides inadequate responses.
• Create search queries, test them, document failures, and write instructions and evaluation criteria.

Skills

Research skills

Critical thinking

Attention to detail

Problem-solving mindset

Domain knowledge

Writing clarity

Locale knowledge

Job description

Openkrill is launching a language evaluation project and seeks English-speaking experts to join as freelance contractors. You will identify AI response failures, craft queries, test results, and write evaluation criteria to guide improvements.

The role is remote (UK) with 20 hours per week, starting ASAP, at a rate of $38 per hour. Strong research, critical thinking, and precise writing are essential for success.