AI Chatbot Tester

Alignerr Corp.

Colombia

Remote

COP 35,245,000 - 79,302,000

Part time

17 hours ago
Be an early applicant
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Benefits offered by this job

Fully remote
Flexible hours
Global community

Job summary

Alignerr Corp. is seeking AI Chatbot Testers to engage in real conversations with cutting-edge AI systems, provide structured feedback, and influence how models develop. This is a fully remote, flexible hourly contract role — open to anyone with strong communication skills and a curious mind.

You'll work 10–40 hours per week, evaluating responses for helpfulness, accuracy, tone, and safety, and designing prompts to probe capabilities and edge cases. No prior AI experience required.

Qualifications

  • Strong communication skills and the ability to write clearly.
  • Curious mindset with an interest in exploring ideas across subjects.
  • Ability to evaluate response quality objectively and consistently.

Responsibilities

  • Engage in diverse conversations with AI chatbots across topics and scenarios.
  • Evaluate chatbot responses for helpfulness, accuracy, tone, and safety.
  • Identify issues such as incorrect information, awkward phrasing, inconsistencies, or potential bias.
  • Design prompts to probe AI capabilities and expose weaknesses.
  • Submit detailed, structured feedback using clear rubrics and notes.
  • Work independently and asynchronously on your schedule.

Job description

About The Role

What if your opinion could make AI smarter, safer, and more useful for millions of people? That's exactly what AI Chatbot Testers do at Alignerr. You'll engage in real conversations with cutting-edge AI systems, evaluate how they respond, and provide structured feedback that directly influences how these models develop.

This is a fully remote, flexible contract role — open to anyone with strong communication skills and a curious mind. No technical background required.

  • Organization: Alignerr
  • Type: Hourly Contract
  • Location: Remote
  • Commitment: 10–40 hours/week
What You'll Do
  • Engage in diverse conversations with AI chatbots across a wide range of topics and scenarios
  • Evaluate chatbot responses for helpfulness, accuracy, tone, and safety
  • Identify issues such as incorrect information, awkward phrasing, inconsistencies, or potential bias
  • Design creative and challenging prompts to probe AI capabilities and expose weaknesses
  • Submit detailed, structured feedback using clear rating rubrics and written notes
  • Work independently and asynchronously on your own schedule
Who You Are
  • Naturally curious — you enjoy exploring ideas across different subjects
  • Able to evaluate response quality with objectivity and consistency
  • A clear and confident written communicator
  • Comfortable navigating chat-based tools and digital interfaces
  • Self-motivated and reliable when working independently
  • No prior AI or technical experience required
Nice to Have
  • Experience in writing, editing, journalism, or research
  • A background in critical thinking, philosophy, or communication
  • Familiarity with AI tools or chatbot platforms
  • Ability to think adversarially — finding edge cases and unexpected failure points
Why Join Us
  • Work on cutting-edge AI projects alongside top research labs
  • Fully remote and flexible — set your own hours and work from anywhere
  • Freelance perks: autonomy, variety, and a chance to collaborate with a global community
  • Contribute to meaningful work that makes AI safer and more helpful for everyone
  • Potential for ongoing work and contract extension based on performance
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Chatbot Tester - Flexible Contract
Remote AI Chatbot Tester - Flexible Contract

Alignerr Corp. • Colombia

Remote
COP 35,245,000 - 79,302,000
Fully remote
Flexible hours
Global community
AI Data Quality Analyst
AI Data Quality Analyst

Alignerr Corp. • Colombia

Remote
COP 66,085,000 - 110,141,000
Fully remote
Flexible hours
Meaningful work
+1
AI Training Specialist
AI Training Specialist

Alignerr Corp. • Colombia

Remote
COP 66,085,000 - 110,141,000
Fully remote
Flexible schedule
AI Ethics Reviewer
AI Ethics Reviewer

Alignerr Corp. • Colombia

Remote
COP 110,441,000 - 176,706,000
Content Reviewer
Content Reviewer

Alignerr Corp. • Colombia

Remote
COP 52,868,000 - 79,302,000
AI Policy, Ethics & Compliance Analyst
AI Policy, Ethics & Compliance Analyst

Alignerr Corp. • Colombia

Remote
COP 66,265,000 - 154,618,000
Generalist
Generalist

Alignerr Corp. • Colombia

Remote
COP 66,085,000 - 110,141,000
Search Quality Evaluator
Search Quality Evaluator

Alignerr Corp. • Colombia

Remote
COP 52,868,000 - 88,113,000
Software Engineer (AI Training)
Software Engineer (AI Training)

Alignerr Corp. • Pereira

Remote
COP 176,305,000 - 352,609,000
AI Red Team Tester
AI Red Team Tester

Alignerr Corp. • Colombia

Remote
COP 88,353,000 - 176,706,000