German AI Product Evaluator

Remotedxb; Dubai; On-site; AED 67,000 - 100,000; Full time

Job summary

Productive Playhouse in Dubai is seeking a language AI test specialist to evaluat(e) German language models. You will conduct structured conversations in German, with prompts and goals, and participate in voice-based interactions with AI systems.

You will submit deliverables such as write-ups, ratings, screenshots, or recordings as specified in the Statement of Work, and assess capabilities, safety, and helpfulness to inform model development.

Qualifications

• Native or expert-level fluency in German (as spoken in Germany).
• Strong English reading, writing, and communication skills.
• Hands-on experience using AI models or large language models.
• Ability to pass a language proficiency and technical literacy assessment.
• Possession of a smartphone, computer, and reliable internet.
• Comfortable with both written and voice-based conversation.

Responsibilities

• Test and evaluate AI chatbots or language models through structured conversations using assigned goals and prompts.
• Participate in voice-based interactions with AI models.
• Submit deliverables including write-ups, ratings, screenshots, or recordings as specified in the Statement of Work
• Assess AI capabilities, safety, and helpfulness to inform model development

Skills

German fluency

English proficiency

AI/LLM experience

Language proficiency assessment

Smartphone/Internet

Voice-based communication

Job description

Responsibilities

• Test and evaluate AI chatbots or language models through structured conversations using assigned goals and prompts
• Participate in voice-based interactions with AI models
• Submit deliverables including write-ups, ratings, screenshots, or recordings as specified in the Statement of Work
• Assess AI capabilities, safety, and helpfulness to inform model development

Requirements

• Native or expert-level fluency in German (as spoken in Germany)
• Strong English reading, writing, and communication skills
• Hands-on experience using AI models or large language models
• Ability to pass a language proficiency and technical literacy assessment
• Possession of a smartphone, computer, and reliable internet
• Comfortable with both written and voice-based conversation

About the Company

Productive Playhouse is a global data company specializing in transcription, translation, linguistic analysis, and AI evaluation to help preserve languages and cultures.