Remote AI Conversation Evaluator (Part-Time, 3 months)

OpenKrill; United States; Remote; USD 28,000 - 55,000; Part time

Job summary

Anyone AI is seeking experts to evaluate personalized AI conversations by engaging in natural, back-and-forth dialogues with two AI assistants. You will compare how well each assistant uses information from your connected services and prior activity to address your questions, interests, and needs.

Applicants should demonstrate fluency in a supported language, strong reading comprehension, and clear, detailed feedback.

Qualifications

• Fluency in one supported language/locale.
• Strong reading comprehension; ability to explain feedback clearly.
• Attention to detail and sound judgment in comparing conversations.
• Willingness to use personal context and connected services.
• Recent activity across qualifying digital services.
• Complete eligibility verification and expert requirements.

Responsibilities

• Write prompts about questions, interests, or needs relevant to you.
• Have natural, multi-turn conversations with two AI assistants.
• Include questions that draw on information from connected services, where relevant.
• Compare how effectively each assistant uses available information and context.
• Assess whether responses feel helpful, natural, trustworthy, and safe.
• Evaluate how the assistants respond to your feedback and corrections.
• Provide clear explanations supporting your evaluations.

Skills

Language fluency

Communication skills

Digital service activity

Job description

Anyone AI is seeking experts to evaluate personalized AI conversations by engaging in natural, back-and-forth dialogues with two AI assistants. You will compare how well each assistant uses information from your connected services and prior activity to address your questions, interests, and needs.

Applicants should demonstrate fluency in a supported language, strong reading comprehension, and clear, detailed feedback.