Remote Chatbot Quality Analyst (Part-Time)

OpenTrain AI, Inc.; United States; Remote; USD 41,000 - 83,000; Part time

Job summary

OpenTrain AI, Inc. is seeking an entry-level remote QA contractor to review and compare chatbot answers for accuracy and clarity. This part-time engagement runs for approximately 16 weeks, with 20+ hours per week across five days.

You will evaluate multiple chatbots, document findings, and provide structured feedback to QA and project teams. The role emphasizes attention to detail, analytical thinking, and strong written/verbal communication.

Qualifications

• Prior QA, data annotation or testing experience is required.
• Experience with chatbot evaluation or LLM projects is helpful.

Responsibilities

• Compare responses produced by multiple chatbots.
• Review accuracy, relevance, completeness, clarity, and guideline compliance.
• Identify errors, inconsistencies, omissions, and other quality issues.
• Provide structured feedback and final quality assessments.
• Document findings clearly and maintain consistency across reviews.
• Collaborate with project and quality teams to resolve questions.
• Escalate complex or ambiguous cases when appropriate.

Skills

Analytical thinking

Critical thinking

Problem-solving

Written communication

Verbal communication

Attention to detail

Tools

AI tools

Chatbots

Online platforms

Job description

OpenTrain AI, Inc. is seeking an entry-level remote QA contractor to review and compare chatbot answers for accuracy and clarity. This part-time engagement runs for approximately 16 weeks, with 20+ hours per week across five days.

You will evaluate multiple chatbots, document findings, and provide structured feedback to QA and project teams. The role emphasizes attention to detail, analytical thinking, and strong written/verbal communication.