Remote Albanian AI Evaluator — Shape Next-Gen Chatbots

Productive Playhouse; United States; Remote; USD 22,000 - 61,000; Part time

Job summary

Productive Playhouse is building an Albanian-speaking evaluator pool for AI chatbot testing. As an AI Evaluator, you’ll interact with AI models to assess capabilities, safety, and usefulness, providing data to improve models. Tasks come in batches with flexible hours and project-based engagement.

Open to freelancers outside the U.S. You’ll receive task-specific SOWs, with opportunities to work on voice-based and written assessments and deliverables across various AI platforms.

Qualifications

• Native or expert-level Albanian fluency (Albanian language)
• Strong English reading, writing and communication skills
• 18 years of age or older
• Hands-on experience using AI models or LLMs
• Comfortable with written and voice-based conversations and follow-ups
• Own smartphone, computer, reliable internet, and comfort with web tools
• Able to pass language proficiency and technical literacy assessment
• Responsive communicator and able to start within 48 hours

Responsibilities

• Test and evaluate AI chatbots or language models via structured conversations with goals and prompts
• Participate in voice-based interactions; sessions may be recorded and shared with the client
• Submit deliverables (write-ups, ratings, screenshots, recordings) per task specifications

Skills

Albanian fluency

English proficiency

18+ years

AI model experience

written and voice conversations

devices and internet

quick onboarding

start within 48 hours

Job description

Productive Playhouse is building an Albanian-speaking evaluator pool for AI chatbot testing. As an AI Evaluator, you’ll interact with AI models to assess capabilities, safety, and usefulness, providing data to improve models. Tasks come in batches with flexible hours and project-based engagement.

Open to freelancers outside the U.S. You’ll receive task-specific SOWs, with opportunities to work on voice-based and written assessments and deliverables across various AI platforms.