AI Chatbot QA & Evaluation Specialist

Productive Playhouse Inc.; United States; Remote; USD 42,000 - 68,000; Full time

Job summary

Productive Playhouse Inc. is seeking individuals to test and evaluate AI chatbots through structured conversations aligned with specific goals and prompts.

You will perform voice-based interactions, submit deliverables such as write-ups, ratings, screenshots or recordings, and complete any required assessments. Applicants should have native or expert-level English (India variant), solid communication skills, and reliable tech setup.

Qualifications

• Must have native or expert-level English as spoken in India.
• Strong English reading, writing and communication skills.
• Age 18 or older.
• Hands-on experience using AI or large language models.
• Own smartphone, computer and reliable internet.
• Able to pass a language proficiency and technical assessment.
• Able to start within 48 hours.

Responsibilities

• Test and evaluate AI chatbots through structured conversations using assigned goals and prompts.
• Complete voice-based AI interactions for projects that involve them
• Submit deliverables such as write-ups, ratings, screenshots or recordings

Skills

English fluency

English writing

AI/LLM experience

Assessment readiness

Own device & internet

Job description

Productive Playhouse Inc. is seeking individuals to test and evaluate AI chatbots through structured conversations aligned with specific goals and prompts.

You will perform voice-based interactions, submit deliverables such as write-ups, ratings, screenshots or recordings, and complete any required assessments. Applicants should have native or expert-level English (India variant), solid communication skills, and reliable tech setup.