Dutch AI Evaluator (Freelance) – Remote & Flexible Hours

Productive Playhouse

Amsterdam

On-site

EUR 21,000 - 26,000

Part time

14 days+

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

Productive Playhouse in Amsterdam is seeking an AI Evaluator contractor to test and evaluate Dutch-language AI chatbots. You will interact with models, provide structured feedback, and help quantify safety and helpfulness.

Tasks arrive in batches; you choose assignments, set your own hours, and collaborate with other clients. Fluent Dutch and strong English are required, plus access to a smartphone and reliable internet.

Qualifications

Native or expert-level fluency in Dutch (Netherlands).
Strong English reading and writing skills; assessment may be required.
18 years of age or older.
Hands-on experience using AI models or large language models.
Comfortable with both written and voice-based conversation and sharp follow-ups.
Own smartphone, computer, reliable internet, and comfort with web tools.
Able to pass language proficiency and technical literacy assessments.
Responsive communicator and able to start within 48 hours.

Responsibilities

Test and evaluate AI chatbots or language models through structured conversations.
Engage in voice-based interactions where required and record or share sessions as needed.
Submit deliverables (ratings, write-ups, screenshots, recordings) per task specifications.