Spanish Language Specialist - Fully Remote | Upto $25/hr

mercor; Colombia; Remote; COP 98,094,000 - 124,847,000; Part time

Job summary

mercor is seeking an Internet-Native Bilingual Evaluator Expert (Spanish - Latin America) on a remote contract basis. You will evaluate AI outputs for accuracy in online communication, culture, and multilingual interactions, focusing on Latin American Spanish and English.

Responsibilities include analyzing social media content for naturalness and cultural appropriateness, developing evaluation rubrics, and testing models with real-world multilingual prompts.

Qualifications

• Native or near-native fluency in Latin American Spanish and professional fluency in English.
• Strong writing, analytical, and critical thinking skills.
• Deep familiarity with internet culture and online communities in Spanish-speaking Latin America.
• Experience with evaluating multilingual content and online behavior.

Responsibilities

• Evaluate AI model outputs across English and Spanish to ensure accuracy in online communication and cultural references.
• Analyse content from social media, forums, and online communities for naturalness, fluency, and cultural appropriateness.
• Identify issues with slang, memes, abbreviations, and evolving online language in Latin America.
• Develop rubrics and guidelines for evaluating bilingual and internet-native communication.
• Test language models using multilingual prompts and provide structured feedback to improve performance.
• Collaborate with project leads to maintain dataset consistency and improve evaluation frameworks.

Skills

Spanish LATAM

English

Writing

Analytical thinking

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey.

Position: Internet-Native Bilingual Evaluator Expert (Spanish - Latin America)

Type: Contract

Compensation: $25/hour

Location: Remote

Commitment: 10-20 hours/week

Role Responsibilities

• Evaluate AI model outputs across English and Spanish to ensure accuracy in modern online communication, cultural references, and multilingual interactions.
• Analyse content from social media, forums, and online communities for naturalness, fluency, and cultural appropriateness.
• Identify issues with slang, memes, abbreviations, and evolving online language specific to Latin American internet culture.
• Develop detailed rubrics and guidelines for evaluating bilingual and internet-native communication.
• Test language models using real-world multilingual prompts and provide structured feedback to improve model performance.
• Collaborate with project leads to maintain consistency across datasets and improve evaluation frameworks.

Qualifications Must-Have

• Native or near-native fluency in Latin American Spanish and professional fluency in English.
• Deep familiarity with internet culture and online communities in Spanish-speaking countries in Latin America.
• Active engagement with platforms like YouTube , TikTok , Reddit , Discord , Instagram , Twitch , Facebook , and WhatsApp .
• Strong understanding of Latin American Spanish slang, memes, and digital culture.
• Strong writing, analytical, and critical thinking skills.

Preferred

• Experience in content moderation, localisation, translation, linguistics, social media, journalism, or AI evaluation .
• Familiarity with regional linguistic differences across Mexico, Argentina, Colombia, Chile, Peru, and other Spanish-speaking countries.
• Experience evaluating user-generated content or digital communications.
• Interest in AI , language models, and internet culture research.