Remote Yoruba AI Evaluator — Flexible, Project-Based

productiveplayhouse; United States; Remote; USD 10,000 - 15,000; Full time

Job summary

Productive Playhouse is building a Yoruba-speaking evaluator pool for testing AI chatbots. You will interact with AI models to assess usefulness, safety, and quality, providing actionable feedback. This is an independent contractor, task-based engagement with batches of work and flexible hours.

Open to freelancers outside the U.S., you set your own hours and choose which tasks to take. You can work alongside other clients, and all engagements start after identity verification and onboarding with

Qualifications

• Native or expert Yoruba fluency (Nigeria dialect).
• Strong English reading, writing, and communication skills.
• 18+ years old and able to pass proficiency assessment.
• Experience using AI models or large language models.
• Comfort with written and voice-based conversations.

Responsibilities

• Test and evaluate AI chatbots and language models through structured conversations.
• Interact directly with AI models to assess capabilities, safety, and helpfulness.
• Submit deliverables (write-ups, ratings, screenshots or recordings) as required by each task.

Skills

Yoruba fluency

English communication

AI model experience

Voice/text conversations

Onboarding readiness

Job description

Productive Playhouse is building a Yoruba-speaking evaluator pool for testing AI chatbots. You will interact with AI models to assess usefulness, safety, and quality, providing actionable feedback. This is an independent contractor, task-based engagement with batches of work and flexible hours.

Open to freelancers outside the U.S., you set your own hours and choose which tasks to take. You can work alongside other clients, and all engagements start after identity verification and onboarding with