Remote Japanese AI Evaluator — Shape Next‑Gen Chatbots

Productive Playhouse; United States; Remote; USD 27,000 - 39,000; Part time

Benefits offered by this job

Flexible hours

Remote work

No micromanagement

Job summary

Productive Playhouse is seeking a Japanese AI Product Evaluator for a remote, freelance, task-based engagement. You will interact with AI models in structured conversations to assess capabilities, safety, and usefulness, and submit deliverables as required by each task.

Responsibilities include testing conversation scenarios, potentially voice interactions, and delivering clear assessments. You can choose tasks, set hours, and work with other clients as projects evolve.

Qualifications

• Native or expert-level fluency in Japanese, as spoken in Japan.
• Strong English reading, writing, and communication skills.
• 18 years of age or older.
• Hands-on experience using AI models or large language models.
• Comfortable with both written and voice-based conversation and asking sharp follow-ups.

Responsibilities

• Test and evaluate AI chatbots or language models through structured conversations.
• Provide deliverables (write-ups, ratings, screenshots, or recordings) per task requirements.
• Participate in iterative evaluation cycles with batches of work.

Skills

Japanese fluency

English communication

AI model experience

Remote work

Job description

Productive Playhouse is seeking a Japanese AI Product Evaluator for a remote, freelance, task-based engagement. You will interact with AI models in structured conversations to assess capabilities, safety, and usefulness, and submit deliverables as required by each task.

Responsibilities include testing conversation scenarios, potentially voice interactions, and delivering clear assessments. You can choose tasks, set hours, and work with other clients as projects evolve.