Remote AI Conversation Evaluator & Personalization Tester

Anyone AI Inc.

Lisboa

Remote

EUR 28,000 - 48,000

Part time

4 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Anyone AI is seeking participants to evaluate AI conversations in a remote, part-time capacity. You will engage in natural, multi-turn conversations with two AI assistants and write prompts that draw on your own interests or needs.

You’ll also reference information from your connected services to test relevance and personalization. The role emphasizes clear, structured feedback on usefulness, naturalness, trustworthiness, and safety, with emphasis on how well each assistant handles user

Qualifications

  • Fluency in one of the supported languages/locales.
  • Strong reading comprehension and the ability to explain your feedback clearly.
  • Willingness to interact with AI using relevant personal context and connected services.
  • Recent activity across a qualifying combination of digital services.
  • Completion of the project’s eligibility verification and corresponding expert requirements.

Responsibilities

  • Write prompts about questions, interests, or needs relevant to you.
  • Have natural, multi-turn conversations with two AI assistants.
  • Include questions that draw on information or activity from your connected services, where relevant.
  • Compare how effectively each assistant uses available information and connects relevant context.
  • Assess whether responses feel helpful, natural, trustworthy, and safe.
  • Evaluate how each assistant responds to your feedback and corrections.
  • Provide clear explanations supporting your evaluations.

Skills

Attention to detail
Clear feedback
Reading comprehension
Feedback explanation

Job description

Anyone AI is seeking participants to evaluate AI conversations in a remote, part-time capacity. You will engage in natural, multi-turn conversations with two AI assistants and write prompts that draw on your own interests or needs.

You’ll also reference information from your connected services to test relevance and personalization. The role emphasizes clear, structured feedback on usefulness, naturalness, trustworthiness, and safety, with emphasis on how well each assistant handles user

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Agent Evaluator
AI Agent Evaluator

Anyone AI Inc. • Lisboa

Remote
EUR 28,000 - 48,000
Global Multilingual AI Evaluator (Remote)
Global Multilingual AI Evaluator (Remote)

Anyone AI Inc. • Lisboa

Remote
EUR 28,000 - 55,000
Remote AI Chatbot Tester – Flexible, Insightful Feedback
Remote AI Chatbot Tester – Flexible, Insightful Feedback

Alignerr Corp. • Portugal

Remote
EUR 21,000 - 41,000
Fully remote
Flexible schedule
Remote AI Coding & Content Evaluator
Remote AI Coding & Content Evaluator

Anyone AI Inc. • Lisboa

Remote
EUR 21,000 - 39,000
Remote AI Conversation Qualitative Analyst (Part-Time)
Remote AI Conversation Qualitative Analyst (Part-Time)

Crossing Hurdles • Portugal

Remote
EUR 32,000 - 46,000
Multilingual Audio Evaluator
Multilingual Audio Evaluator

Anyone AI Inc. • Lisboa

Remote
EUR 28,000 - 55,000
AI Evaluation Specialist - Remote
AI Evaluation Specialist - Remote

YO AI Labs • Lisboa

Remote
EUR 31,000 - 49,000
AI Evaluation Specialist - Remote
AI Evaluation Specialist - Remote

YO AI Labs • Lagos

Remote
EUR 53,000 - 80,000
Remote AI Agent Power User & Workflow QA
Remote AI Agent Power User & Workflow QA

YO AI Labs • Porto

Remote
EUR 54,000 - 80,000
AI Coding Evaluator
AI Coding Evaluator

Anyone AI Inc. • Lisboa

Remote
EUR 21,000 - 39,000
Top locations