Remote QA Analyst — AI Chatbot Evaluations & Feedback

Turing Enterprises, Inc.; New York (NY); Remote; USD 34,000 - 55,000; Part time

Benefits offered by this job

Fully remote

Flexible schedule

Project-based engagement

Job summary

Turing is seeking a detail-oriented QA Analyst to evaluate and compare chatbot responses. You will review outputs against guidelines, identify inaccuracies, and provide clear final assessments for each task. This is a project-based, fully remote freelance role with defined evaluation tasks and deadlines.

Responsibilities include analyzing responses, documenting findings, and collaborating with QA teams to resolve queries while meeting productivity and quality targets over a 16-week period.

Qualifications

• Experience in quality assurance, data annotation, content evaluation or testing.
• Strong analytical, critical-thinking and problem-solving abilities.
• Excellent written and verbal communication skills.
• High attention to detail and ability to spot subtle errors.
• Comfortable working with AI tools, chatbots and online platforms.
• Experience with chatbot evaluation or LLM testing is a plus.

Responsibilities

• Evaluate and compare responses generated by multiple chatbots.
• Assess outputs for accuracy, relevance, completeness, clarity and guideline adherence.
• Identify errors, inconsistencies, missing information and potential quality issues.
• Provide structured feedback and final assessments for each task.
• Follow evaluation guidelines and maintain consistency across reviews.
• Document findings clearly and accurately.
• Collaborate with project and quality teams to resolve queries.
• Meet productivity, quality and turnaround targets.
• Escalate complex cases when necessary.

Skills

Quality Assurance experience

Data annotation

Content evaluation

Analytical thinking

Problem solving

Excellent written and verbal comms

Attention to detail

AI tools & chatbots

LLM testing experience

Job description

Turing is seeking a detail-oriented QA Analyst to evaluate and compare chatbot responses. You will review outputs against guidelines, identify inaccuracies, and provide clear final assessments for each task. This is a project-based, fully remote freelance role with defined evaluation tasks and deadlines.

Responsibilities include analyzing responses, documenting findings, and collaborating with QA teams to resolve queries while meeting productivity and quality targets over a 16-week period.