AI Chatbot QA Analyst - 16-Week Contract (USA)

Codefeast; United States; On-site; USD 34,000 - 49,000; Part time

Job summary

Codefeast is seeking experienced Quality Analysts to support an AI evaluation project focused on reviewing and comparing responses from multiple chatbots. The role requires assessing outputs against guidelines and delivering clear final assessments for each task.

You will work independently, manage multiple evaluation tasks over a 16-week period, and ensure accuracy, relevance, and data quality. Immediate start; USA-only, short-term contract, $30/hour.

Qualifications

• 3+ years of experience in Quality Assurance, Data Annotation, Content Evaluation, Testing, or a similar role.
• Strong analytical, critical-thinking, and problem-solving skills.
• Comfortable working with AI tools, chatbots, and online platforms.

Responsibilities

• Evaluate and compare responses generated by multiple chatbots.
• Assess outputs for accuracy, relevance, completeness, clarity, and guideline adherence.
• Identify errors, inconsistencies, missing information, and subtle quality issues.
• Provide structured feedback and final assessments for each task.

Skills

Quality Assurance

Data Annotation

Content Evaluation

Tools

AI Tools

Chatbots

Job description

Codefeast is seeking experienced Quality Analysts to support an AI evaluation project focused on reviewing and comparing responses from multiple chatbots. The role requires assessing outputs against guidelines and delivering clear final assessments for each task.

You will work independently, manage multiple evaluation tasks over a 16-week period, and ensure accuracy, relevance, and data quality. Immediate start; USA-only, short-term contract, $30/hour.