Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
Remote is seeking French-speaking experts for a freelance language evaluation project. You will identify failures in AI responses, craft search queries, test results, and write clear evaluation criteria and instructions.
Responsibilities focus on local relevance, source quality, outdated information, language mismatches, and region-specific nuances. This remote role offers flexible hours and a $33 per hour rate, with an ongoing contract and 20 hours per week commitment.
Overview
Are you passionate about languages, writing, and quality evaluation? We are launching an exciting language evaluation project and are looking for French-speaking experts to join our team.
Identify realistic search-related failures where an AI model provides inadequate responses. Create search queries, test them, document what went wrong, and write instructions and evaluation criteria for correct answers.
Common issues: local relevance, source quality, outdated information, language mismatches, incomplete answers, and region-specific inapplicability. Testing multiple queries before finding failures is expected.