MSR Project - German Culture Expert

Welocalize, Inc.; United States; Remote; USD 44,000 - 52,000; Part time

Job summary

Welocalize, Inc. is seeking a German-speaking expert for a freelance language-evaluation project. You will identify real-world failures of AI models, craft targeted search queries, and document issues with clear evaluation criteria.

Remote work from Germany is supported, with ongoing part-time hours and focus on linguistic accuracy and locale-specific nuances. The role emphasizes precise source verification, critical thinking, and concise instruction writing to guide model improvements.

Qualifications

• Research skills to locate and verify information from multiple sources
• Critical thinking to spot contradictions and outdated info
• Attention to detail for language nuances and locale variations
• Problem-solving mindset for iterative testing and refinement
• Domain knowledge in research, QA, compliance, or similar work
• Clear writing of instructions and rubrics for reasoning
• Deep familiarity with locale-specific regulations and practices

Responsibilities

• Identify realistic search-related failures where an AI model provides inadequate responses
• Create search queries, test them, document results, and write evaluation criteria
• Provide instructions and rubrics to ensure correct answers and consistent judgments
• Review region-specific information to ensure applicability across locales

Skills

Research skills

Critical thinking

Attention to detail

Problem-solving mindset

Domain knowledge

Writing clarity

Locale knowledge

Job description

Location: Germany

Overview

Areyoupassionateaboutlanguages,writing,andqualityevaluation?WearelaunchinganexcitinglanguageevaluationprojectandarelookingforGerman-speakingexpertstojoinourteam.

Whatyouwilldo:

Identifyrealisticsearch-relatedfailureswhereanAImodelprovidesinadequateresponses.Createsearchqueries,testthem,documentwhatwentwrong,andwriteinstructionsandevaluationcriteriaforcorrectanswers.

Commonissues:

localrelevance,sourcequality,outdatedinformation,languagemismatches,incompleteanswers,andregion-specificinapplicability.Testingmultiplequeriesbeforefindingfailuresisexpected.

ProjectDetails:

• Start Date: ASAP
• Duration:OngoingProject.
• Commitment:20hoursperweek.
• JobType:Freelancecontract.
• Location:Germany,Remote
• Rate:$35perhour.

Requirements:

• Research skills — ability to find and verify information from multiple sources; comfort navigating different websites, databases, and documentation
• Critical thinking — Can spot contradictions between sources, identify outdated information, and recognize when something doesn't apply to a specific locale/context
• Attention to detail — Can catch nuances in language, local variations (prices, regulations, requirements), and edge cases
• Problem-solving mindset — Comfortable iterating and testing when things don't work; doesn't get frustrated by trial-and-error
• Domain knowledge — Ideally someone with background in research, quality assurance, compliance, or similar work that requires precision and source verification
• Writing clarity — Can articulate instructions and rubrics clearly so others understand the logic behind their reasoning
• Locale knowledge — Deep familiarity with their specific locale (local regulations, business practices, cultural nuances) is valuable for spotting region-specific failures