MSR Project - German Culture Expert

Welo Global; United States; Remote; USD 41,000 - 55,000; Part time

Job summary

Welo Global is seeking a German-speaking expert to join an ongoing language evaluation project focused on testing AI responses and regional relevance. This role emphasizes rigorous research, precise documentation, and clear evaluation criteria.

The ideal candidate will have strong research skills, critical thinking, and meticulous attention to detail, with a practical mindset for iterative testing and locale-specific assessments.

Qualifications

• Ability to find and verify information from multiple sources across various websites, databases, and documentation.
• Identify contradictions between sources and detect outdated information.
• Recognize locale-specific nuances and region-specific applicability in content.

Responsibilities

• Identify realistic search-related failures where an AI model provides inadequate responses.
• Create search queries to test the model and document what went wrong.
• Write instructions and evaluation criteria for correct answers.

Skills

Research skills

Critical thinking

Attention to detail

Problem-solving mindset

Domain knowledge

Writing clarity

Locale knowledge

Job description

Overview

Areyoupassionateaboutlanguages,writing,andqualityevaluation?WearelaunchinganexcitinglanguageevaluationprojectandarelookingforGerman-speakingexpertstojoinourteam.

Whatyouwilldo:

Identifyrealisticsearch-relatedfailureswhereanAImodelprovidesinadequateresponses.Createsearchqueries,testthem,documentwhatwentwrong,andwriteinstructionsandevaluationcriteriaforcorrectanswers.

Commonissues:

localrelevance,sourcequality,outdatedinformation,languagemismatches,incompleteanswers,andregion-specificinapplicability.Testingmultiplequeriesbeforefindingfailuresisexpected.

ProjectDetails:

• - Start Date: ASAP
• - Duration:OngoingProject.
• - Commitment:20hoursperweek.
• - JobType:Freelancecontract.
• - Location:Germany,Remote
• - Rate:$35perhour.

Requirements:

• - Research skills — ability to find and verify information from multiple sources; comfort navigating different websites, databases, and documentation
• - Critical thinking — Can spot contradictions between sources, identify outdated information, and recognize when something doesn’t apply to a specific locale/context
• - Attention to detail — Can catch nuances in language, local variations (prices, regulations, requirements), and edge cases
• - Problem-solving mindset — Comfortable iterating and testing when things don’t work; doesn’t get frustrated by trial-and-error
• - Domain knowledge — Ideally someone with background in research, quality assurance, compliance, or similar work that requires precision and source verification
• - Writing clarity — Can articulate instructions and rubrics clearly so others understand the logic behind their reasoning
• - Locale knowledge — Deep familiarity with their specific locale (local regulations, business practices, cultural nuances) is valuable for spotting region-specific failures