MSR Project - Spanish (LATAM) Culture Expert

Welocalize, Inc.; United States; Remote; USD 28,000 - 55,000; Full time

Job summary

Welocalize, Inc. seeks Spanish LATAM language experts for a remote, freelance evaluation project. You will identify real-world search-related failures where AI responses are inadequate, run test queries, and document results.

Duration is ongoing with ASAP start and 20 hours per week at $30 per hour; remote work. Ideal candidates have strong research, critical thinking, attention to detail, and locale knowledge, with experience in QA or compliance.

Qualifications

• Research skills—ability to locate and verify information from multiple sources.
• Critical thinking—spot contradictions and identify outdated info.
• Attention to detail—note language nuances and locale differences.
• Problem-solving mindset—iterate and test when things fail.
• Domain knowledge—background in research, QA, or compliance helps.
• Writing clarity—articulate instructions and rubrics clearly.
• Locale knowledge—familiarity with locale-specific regulations and practices.

Responsibilities

• Identify realistic search-related failures where an AI model provides inadequate responses.
• Create search queries, test them, document what went wrong, and provide evaluation criteria.
• Write instructions and evaluation rubrics for correct answers.

Skills

Research skills

Critical thinking

Attention to detail

Problem solving

Domain knowledge

Writing clarity

Locale knowledge

Job description

Location: Colombia

Overview

Areyoupassionateaboutlanguages,writing,andqualityevaluation?WearelaunchinganexcitinglanguageevaluationprojectandarelookingforSpanishLATAM-speakingexpertstojoinourteam.

Whatyouwilldo:

Identifyrealisticsearch-relatedfailureswhereanAImodelprovidesinadequateresponses.Createsearchqueries,testthem,documentwhatwentwrong,andwriteinstructionsandevaluationcriteriaforcorrectanswers.

Commonissues:localrelevance,sourcequality,outdatedinformation,languagemismatches,incompleteanswers,andregion-specificinapplicability.Testingmultiplequeriesbeforefindingfailuresisexpected.

ProjectDetails:

- Start Date: ASAP

- Duration:OngoingProject.

- Commitment:20hoursperweek.

- JobType:Freelancecontract.

- Location:Remote

- Rate:$30perhour.

Requirements:

- Research skills — ability to find and verify information from multiple sources; comfort navigating different websites, databases, and documentation

- Critical thinking — Can spot contradictions between sources, identify outdated information, and recognize when something doesn't apply to a specific locale/context

- Attention to detail — Can catch nuances in language, local variations (prices, regulations, requirements), and edge cases

- Problem-solving mindset — Comfortable iterating and testing when things don't work; doesn't get frustrated by trial-and-error

- Domain knowledge — Ideally someone with background in research, quality assurance, compliance, or similar work that requires precision and source verification

- Writing clarity — Can articulate instructions and rubrics clearly so others understand the logic behind their reasoning

- Locale knowledge — Deep familiarity with their specific locale (local regulations, business practices, cultural nuances) is valuable for spotting region-specific failures