Italian AI Evaluator (Remote, Flexible Hours)

Productive Playhouse; California (MO); Hybrid; USD 22,000 - 29,000; Part time

Job summary

Productive Playhouse is building a pool of Italian-speaking evaluators for testing AI chatbots. As an independent contractor, you will interact with models to assess accuracy, safety, and usefulness. Tasks arrive in batches and you choose which to take, with flexible hours and 100% remote work.

Requirements include native Italian and strong English, plus hands-on experience with AI models. Start within 48 hours and communicate promptly with the project team.

Qualifications

• Must be fluent in Italian (native/expert) and proficient in English.
• Hands-on experience using AI models or large language models.
• Comfortable with both written and voice-based conversations.
• Own device and reliable internet for web-based tools.
• Able to start within 48 hours.

Responsibilities

• Test and evaluate AI chatbots and language models through structured conversations.
• Participate in voice-based sessions; recordings may be shared with the client.
• Submit deliverables (write-ups, ratings, screenshots, or recordings) as required.

Skills

Italian fluency

English proficiency

AI model experience

Voice conversations

Remote work readiness

Job description

Productive Playhouse is building a pool of Italian-speaking evaluators for testing AI chatbots. As an independent contractor, you will interact with models to assess accuracy, safety, and usefulness. Tasks arrive in batches and you choose which to take, with flexible hours and 100% remote work.

Requirements include native Italian and strong English, plus hands-on experience with AI models. Start within 48 hours and communicate promptly with the project team.