German Culture Expert

Welo Data; United States; Remote; USD 41,000 - 55,000; Full time

Job summary

Welo Data in Germany is seeking a German-speaking culture expert to join a language-evaluation project as a freelance MSR project contributor. The role focuses on testing AI language outputs and improving assessment processes.

You will design search prompts, run tests, record failures, and draft clear evaluation criteria for correct responses. Ideal candidates have sharp research instincts and a flair for precise analysis of locale-specific nuances.

Qualifications

• Research skills: ability to find and verify information from multiple sources
• Critical thinking: spot contradictions and outdated information
• Attention to detail: catch language nuances and locale variations
• Problem-solving mindset: iterate and test when things don’t work
• Domain knowledge: background in research, QA, compliance or similar
• Writing clarity: articulate instructions and rubrics clearly
• Locale knowledge: familiarity with locale/regional nuances

Responsibilities

• Identify realistic search-related failures where an AI model provides inadequate responses
• Create search queries, test them, document what went wrong, and write instructions and evaluation criteria for correct answers
• Test multiple queries to uncover failures and refine evaluation rubrics

Job description

Overview

Are you passionate about languages, writing, and quality evaluation? We are launching an exciting language evaluation project and are looking for German-speaking experts to join our team.

Project Details

• Job Title: MSR Project - German Culture Expert
• Start Date: ASAP
• Duration:OngoingProject.
• Commitment:20hoursperweek.
• Job Type:Freelancecontract.
• Location:Germany,Remote
• Rate: US$35perhour.

What you will do

Identify realistic search-related failures where an AI model provides inadequate responses.

Create search queries, test them, document what went wrong, and write instructions and evaluation criteria for correct answers.

Common issues: local relevance, source quality, outdated information, language mismatches, incomplete answers, and region-specific inapplicability. Testing multiple queries before finding failures is expected.

Requirements

• Research skills: ability to find and verify information from multiple sources; comfort navigating different websites, databases, and documentation
• Critical thinking: Can spot contradictions between sources, identify outdated information, and recognize when something doesn't apply to a specific locale/context
• Attention to detail: Can catch nuances in language, local variations (prices, regulations, requirements), and edge cases
• Problem-solving mindset: Comfortable iterating and testing when things don't work; doesn't get frustrated by trial-and-error
• Domain knowledge: Ideally someone with background in research, quality assurance, compliance, or similar work that requires precision and source verification
• Writing clarity: Can articulate instructions and rubrics clearly so others understand the logic behind their reasoning
• Locale knowledge: Deep familiarity with their specific locale (local regulations, business practices, cultural nuances) is valuable for spotting region-specific failures