Remote Japanese AI Evaluator & Feedback Specialist

Handshake; United States; Remote; USD 25,000 - 41,000; Part time

Benefits offered by this job

Flexible hours

Remote work

Job summary

Handshake is seeking a Japanese-speaking specialist based in Japan to evaluate and rank AI responses using your real-world ChatGPT experience. This is a remote, asynchronous, part-time project role that can be done alongside current commitments.

You will review AI-generated replies, provide honest preferences and reasoning, and deliver clear feedback to improve personalization for individual users. Flexible hours apply.

Qualifications

• Location — Based in Japan, remote/asynchronous capacity.
• Fluent in Japanese (written and spoken) with clear reasoning.
• Good working understanding of English (B2 level) as materials are in English.
• Hands-on AI experience using ChatGPT or similar tools.
• Ability to compare two AI responses and defend preferences.

Responsibilities

• Complete tasks on Handshake's annotation platform using real-world AI experience.
• Compare and evaluate AI-generated responses and share preferences and reasoning.
• Provide clear written feedback to help personalize responses for users.
• Work at your own pace with no set schedule or minimum hours.

Skills

Japanese language

Remote work

English proficiency

AI evaluation experience

Judgment and reasoning

Job description

Handshake is seeking a Japanese-speaking specialist based in Japan to evaluate and rank AI responses using your real-world ChatGPT experience. This is a remote, asynchronous, part-time project role that can be done alongside current commitments.

You will review AI-generated replies, provide honest preferences and reasoning, and deliver clear feedback to improve personalization for individual users. Flexible hours apply.