Remote AI Chatbot Quality Evaluator

Alignerr Corp.; Colombia; Remote; COP 53,508,000 - 111,474,000; Part time

Job summary

Alignerr Corp. is seeking AI Chatbot Testers to engage in real conversations with cutting-edge AI systems, evaluate responses for helpfulness and safety, and provide structured feedback that shapes model development. This is a fully remote, hourly contract role with flexible scheduling (10–40 hours per week). No technical background is required.

Ideal candidates are naturally curious, excellent writers, and able to work independently and asynchronously using chat-based tools.

Qualifications

• Excellent written communication skills.
• Ability to work asynchronously.
• No technical background required.
• Strong observational and analytical abilities.

Responsibilities

• Engage in diverse conversations with AI chatbots.
• Evaluate chatbot responses for helpfulness, accuracy, tone, and safety.
• Identify issues such as incorrect information, awkward phrasing, inconsistencies, or potential bias.
• Design creative prompts to probe AI capabilities and reveal weaknesses.
• Submit detailed, structured feedback using clear rubrics and notes.
• Work independently and on your own schedule.

Skills

Curious mindset

Strong written communication

Independent work

Detail oriented

Tools

Chat tools

Job description

Alignerr Corp. is seeking AI Chatbot Testers to engage in real conversations with cutting-edge AI systems, evaluate responses for helpfulness and safety, and provide structured feedback that shapes model development. This is a fully remote, hourly contract role with flexible scheduling (10–40 hours per week). No technical background is required.

Ideal candidates are naturally curious, excellent writers, and able to work independently and asynchronously using chat-based tools.