Urdu AI Evaluator - Freelance, Remote, Flexible Hours

productiveplayhouse; United States; Remote; USD 11,000 - 14,000; Part time

Job summary

Productive Playhouse is seeking an AI Evaluator to participate in structured conversations with AI models, assessing capabilities, safety, and helpfulness. You will contribute to model improvement by providing direct language data and insights.

Work is project-based, batch-driven, and remote, with the flexibility to choose tasks and set hours. You may receive varied tasks and must be able to start within 48 hours.

Qualifications

• Native or expert-level fluency in Urdu, as spoken in Pakistan.
• Strong English reading, writing, and communication skills; assessment may be required.
• 18 years of age or older.
• Hands-on experience using AI models or large language models.
• Comfortable with both written and voice-based conversation and sharp follow-ups.
• Own smartphone, computer, reliable internet, and comfort with web-based tools.
• Able to pass a language proficiency and technical literacy assessment.
• Responsive communicator; quick replies move onboarding faster.
• Able to start within 48 hours.

Responsibilities

• Test and evaluate AI chatbots or language models through structured conversations with goals and prompts.
• Conduct voice-based interactions where required; sessions may be recorded and shared with the client.
• Submit deliverables (write-ups, ratings, screenshots, or recordings) as specified in each task's SOW.

Skills

Urdu fluency

English proficiency

AI model experience

Written & spoken communication

Onboarding speed

Job description

Productive Playhouse is seeking an AI Evaluator to participate in structured conversations with AI models, assessing capabilities, safety, and helpfulness. You will contribute to model improvement by providing direct language data and insights.

Work is project-based, batch-driven, and remote, with the flexibility to choose tasks and set hours. You may receive varied tasks and must be able to start within 48 hours.