Remote AI Chatbot Evaluator — Flexible Contract

Alignerr Corp.; Italia; Remote; EUR 17,000 - 33,000; Full time

Benefits offered by this job

Remote work

Job summary

Alignerr is seeking AI Chatbot Testers to engage with cutting-edge AI systems, evaluate how they respond, and provide the kind of real human feedback that makes these systems smarter, safer, and more helpful for everyone. This is a fully remote, flexible contract role — no technical background required.

If you're naturally curious, enjoy exploring ideas across different topics, and have a sharp eye for when something just doesn't sound right, this role is a great fit.

Qualifications

• Naturally curious and comfortable exploring a wide variety of conversation topics.
• Able to evaluate response quality objectively and explain your reasoning clearly.
• A strong communicator in written English.
• Comfortable using chat-based interfaces and simple online tools.
• Detail-oriented with a good instinct for when something feels off.
• No prior AI, technical, or QA experience required.

Responsibilities

• Hold conversations with AI chatbots across a wide range of topics and scenarios.
• Rate responses for helpfulness, accuracy, tone, and safety.
• Identify problems like factual errors, awkward phrasing, inconsistencies, or bias.
• Push the AI with creative, unexpected, or challenging prompts to find its limits.
• Document your findings clearly using structured feedback forms and rating rubrics.
• Work independently and asynchronously — on your own schedule.

Skills

Curious

Objective evaluation

Written English

Clear reasoning

Detail-oriented

Tools

Chat-based interfaces

Job description

Alignerr is seeking AI Chatbot Testers to engage with cutting-edge AI systems, evaluate how they respond, and provide the kind of real human feedback that makes these systems smarter, safer, and more helpful for everyone. This is a fully remote, flexible contract role — no technical background required.

If you're naturally curious, enjoy exploring ideas across different topics, and have a sharp eye for when something just doesn't sound right, this role is a great fit.