Remote AI Chatbot Evaluator — Flexible Hours

Alignerr Corp.; Italia; Remote; EUR 2,066,000 - 3,444,000; Full time

Benefits offered by this job

Autonomy

Variety

Work from anywhere

Job summary

Alignerr is seeking AI Chatbot Testers to engage with cutting-edge AI systems, evaluate responses, and provide real human feedback that improves safety and usefulness. This is a fully remote, flexible hourly contract with 10–40 hours per week.

You will hold conversations with chatbots, rate helpfulness and tone, identify issues like factual errors or bias, and document findings using simple feedback forms. No technical background is required; curiosity and clear written communication are key.

Qualifications

• Naturally curious and comfortable exploring a wide variety of conversation topics
• Able to evaluate response quality objectively and explain reasoning clearly
• Strong written English communication
• Comfortable using chat-based interfaces and simple online tools
• Detail-oriented with good instinct for when something feels off
• No prior AI, technical, or QA experience required

Responsibilities

• Hold conversations with AI chatbots across a wide range of topics and scenarios
• Rate responses for helpfulness, accuracy, tone, and safety
• Identify problems like factual errors, awkward phrasing, inconsistencies, or bias
• Push the AI with creative, unexpected, or challenging prompts to find its limits
• Document your findings clearly using structured feedback forms and rating rubrics
• Work independently and asynchronously — on your own schedule

Job description

Alignerr is seeking AI Chatbot Testers to engage with cutting-edge AI systems, evaluate responses, and provide real human feedback that improves safety and usefulness. This is a fully remote, flexible hourly contract with 10–40 hours per week.

You will hold conversations with chatbots, rate helpfulness and tone, identify issues like factual errors or bias, and document findings using simple feedback forms. No technical background is required; curiosity and clear written communication are key.