Urdu AI Evaluator — Freelance, Flexible Hours

Productive Playhouse; United States; Remote; USD 10,000 - 15,000; Part time

Job summary

Productive Playhouse is building a pool of Urdu-speaking evaluators for testing and judging AI chatbots. This independent contractor role lets you choose tasks, set your own hours, and work with other clients while contributing to model evaluation.

You will engage in structured, hands-on assessments of AI models, including conversations and potential voice interactions, with deliverables defined by each project’s SOW. The work is batch-based and flexible.

Qualifications

• Fluency in Urdu (Pakistan dialect)
• Strong English reading and writing skills
• Experience using AI models or large language models
• Comfort with written and voice conversations
• Responsive communicator and quick onboarding capability
• Own smartphone, computer, reliable internet

Responsibilities

• Interact directly with AI models to evaluate capabilities, safety, and usefulness
• Participate in structured evaluation tasks based on SOW for each batch
• Submit deliverables such as write-ups, ratings, and recordings per task requirements

Skills

Urdu fluency

English proficiency

AI model experience

Written and verbal communication

Fast on-boarding

Tools

Smartphone

Computer

Reliable Internet

Job description

Productive Playhouse is building a pool of Urdu-speaking evaluators for testing and judging AI chatbots. This independent contractor role lets you choose tasks, set your own hours, and work with other clients while contributing to model evaluation.

You will engage in structured, hands-on assessments of AI models, including conversations and potential voice interactions, with deliverables defined by each project’s SOW. The work is batch-based and flexible.