Remote AI Chatbot Tester — Flexible, Impactful Feedback

Alignerr Corp.; Colombia; Remote; COP 35,077,000 - 70,154,000; Part time

Benefits offered by this job

Autonomy

Flexible hours

Global community

Job summary

Alignerr is seeking AI Chatbot Testers to engage in real conversations with cutting-edge AI systems. You will evaluate responses for helpfulness, safety, and accuracy, and provide structured feedback that guides model development.

This is a fully remote, flexible contract role suitable for anyone with strong communication skills and a curious mind. No technical background required, with 10–40 hours per week committed.

Qualifications

• Naturally curious — you enjoy exploring ideas across different subjects.
• Able to evaluate response quality with objectivity and consistency.
• A clear and confident written communicator.
• Comfortable navigating chat-based tools and digital interfaces.
• Self-motivated and reliable when working independently.
• No prior AI or technical experience required.
• Experience in writing, editing, journalism, or research.
• A background in critical thinking, philosophy, or communication.
• Familiarity with AI tools or chatbot platforms.
• Ability to think adversarially — finding edge cases and unexpected failure points.

Responsibilities

• Engage in diverse conversations with AI chatbots across a wide range of topics and scenarios.
• Evaluate chatbot responses for helpfulness, accuracy, tone, and safety.
• Identify issues such as incorrect information, awkward phrasing, inconsistencies, or potential bias.
• Design creative and challenging prompts to probe AI capabilities and expose weaknesses.
• Submit detailed, structured feedback using clear rating rubrics and written notes.
• Work independently and asynchronously on your own schedule.

Skills

Curious mind

Objective evaluation

Written communication

Chat-based tools

Self-motivated

No AI background required

Job description

Alignerr is seeking AI Chatbot Testers to engage in real conversations with cutting-edge AI systems. You will evaluate responses for helpfulness, safety, and accuracy, and provide structured feedback that guides model development.

This is a fully remote, flexible contract role suitable for anyone with strong communication skills and a curious mind. No technical background required, with 10–40 hours per week committed.