Dutch AI Evaluator (Freelance) – Remote & Flexible Hours

Productive Playhouse; Amsterdam; On-site; EUR 21,000 - 26,000; Part time

Job summary

Productive Playhouse in Amsterdam is seeking an AI Evaluator contractor to test and evaluate Dutch-language AI chatbots. You will interact with models, provide structured feedback, and help quantify safety and helpfulness.

Tasks arrive in batches; you choose assignments, set your own hours, and collaborate with other clients. Fluent Dutch and strong English are required, plus access to a smartphone and reliable internet.

Qualifications

• Native or expert-level fluency in Dutch (Netherlands).
• Strong English reading and writing skills; assessment may be required.
• 18 years of age or older.
• Hands-on experience using AI models or large language models.
• Comfortable with both written and voice-based conversation and sharp follow-ups.
• Own smartphone, computer, reliable internet, and comfort with web tools.
• Able to pass language proficiency and technical literacy assessments.
• Responsive communicator and able to start within 48 hours.

Responsibilities

• Test and evaluate AI chatbots or language models through structured conversations.
• Engage in voice-based interactions where required and record or share sessions as needed.
• Submit deliverables (ratings, write-ups, screenshots, recordings) per task specifications.

Skills

Dutch language fluency

English writing

AI model experience

Voice-based interaction

Tech readiness

Fast onboarding

Job description

Productive Playhouse in Amsterdam is seeking an AI Evaluator contractor to test and evaluate Dutch-language AI chatbots. You will interact with models, provide structured feedback, and help quantify safety and helpfulness.

Tasks arrive in batches; you choose assignments, set your own hours, and collaborate with other clients. Fluent Dutch and strong English are required, plus access to a smartphone and reliable internet.