AI Chatbot Tester

Alignerr Corp.; Colombia; Remote; COP 35,077,000 - 70,154,000; Part time

Benefits offered by this job

Autonomy

Flexible hours

Global community

Job summary

Alignerr is seeking AI Chatbot Testers to engage in real conversations with cutting-edge AI systems. You will evaluate responses for helpfulness, safety, and accuracy, and provide structured feedback that guides model development.

This is a fully remote, flexible contract role suitable for anyone with strong communication skills and a curious mind. No technical background required, with 10–40 hours per week committed.

Qualifications

• Naturally curious — you enjoy exploring ideas across different subjects.
• Able to evaluate response quality with objectivity and consistency.
• A clear and confident written communicator.
• Comfortable navigating chat-based tools and digital interfaces.
• Self-motivated and reliable when working independently.
• No prior AI or technical experience required.
• Experience in writing, editing, journalism, or research.
• A background in critical thinking, philosophy, or communication.
• Familiarity with AI tools or chatbot platforms.
• Ability to think adversarially — finding edge cases and unexpected failure points.

Responsibilities

• Engage in diverse conversations with AI chatbots across a wide range of topics and scenarios.
• Evaluate chatbot responses for helpfulness, accuracy, tone, and safety.
• Identify issues such as incorrect information, awkward phrasing, inconsistencies, or potential bias.
• Design creative and challenging prompts to probe AI capabilities and expose weaknesses.
• Submit detailed, structured feedback using clear rating rubrics and written notes.
• Work independently and asynchronously on your own schedule.

Skills

Curious mind

Objective evaluation

Written communication

Chat-based tools

Self-motivated

No AI background required

Job description

About The Role

What if your opinion could make AI smarter, safer, and more useful for millions of people? That's exactly what AI Chatbot Testers do at Alignerr. You'll engage in real conversations with cutting-edge AI systems, evaluate how they respond, and provide structured feedback that directly influences how these models develop.

About The Role

What if your opinion could make AI smarter, safer, and more useful for millions of people? That's exactly what AI Chatbot Testers do at Alignerr. You'll engage in real conversations with cutting-edge AI systems, evaluate how they respond, and provide structured feedback that directly influences how these models develop. This is a fully remote, flexible contract role — open to anyone with strong communication skills and a curious mind. No technical background required.

• Organization: Alignerr
• Type: Hourly Contract
• Location: Remote
• Commitment: 10–40 hours/week

What You'll Do

• Engage in diverse conversations with AI chatbots across a wide range of topics and scenarios
• Evaluate chatbot responses for helpfulness, accuracy, tone, and safety
• Identify issues such as incorrect information, awkward phrasing, inconsistencies, or potential bias
• Design creative and challenging prompts to probe AI capabilities and expose weaknesses
• Submit detailed, structured feedback using clear rating rubrics and written notes
• Work independently and asynchronously on your own schedule

Who You Are

• Naturally curious — you enjoy exploring ideas across different subjects
• Able to evaluate response quality with objectivity and consistency
• A clear and confident written communicator
• Comfortable navigating chat-based tools and digital interfaces
• Self-motivated and reliable when working independently
• No prior AI or technical experience required

Nice to Have

• Experience in writing, editing, journalism, or research
• A background in critical thinking, philosophy, or communication
• Familiarity with AI tools or chatbot platforms
• Ability to think adversarially — finding edge cases and unexpected failure points

Why Join Us

• Work on cutting-edge AI projects alongside top research labs
• Fully remote and flexible — set your own hours and work from anywhere
• Freelance perks: autonomy, variety, and a chance to collaborate with a global community
• Contribute to meaningful work that makes AI safer and more helpful for everyone
• Potential for ongoing work and contract extension based on performance