Remote QA Analyst - Chatbot Evaluation Specialist

Turing; New York (NY); Remote; USD 27,000 - 55,000; Part time

Benefits offered by this job

Fully remote

Flexible schedule

Global projects

Project-based tasks

Job summary

Turing is seeking a detail-oriented QA Analyst to evaluate and compare chatbot outputs and assess them against defined guidelines. You will identify inaccuracies, gaps, and quality issues, providing clear final assessments for each evaluation task.

In this freelance, remote role, you will work with global teams to maintain consistency, document findings, and meet productivity and turnaround targets. Prior chatbot evaluation experience is a plus; strong communication and attention to detail are

Qualifications

• Experience in Quality Assurance, data annotation, content evaluation, testing, or a similar role.
• Strong analytical, critical-thinking, and problem-solving skills.
• Excellent written and verbal communication skills.
• High attention to detail and ability to identify subtle errors.
• Comfortable working with AI tools, chatbots, and online platforms.

Responsibilities

• Evaluate and compare responses generated by multiple chatbots.
• Assess responses for accuracy, relevance, completeness, clarity, and adherence to guidelines.
• Identify errors, inconsistencies, missing information, and potential quality issues.
• Provide structured feedback and final assessments for each task.
• Follow evaluation guidelines and maintain consistency across all reviews.
• Document findings clearly and accurately.
• Collaborate with project and quality teams to resolve queries.
• Meet assigned productivity, quality, and turnaround-time targets.
• Escalate complex or ambiguous cases when necessary.

Skills

QA experience

Analytical thinking

Communication skills

Attention to detail

AI/chatbot familiarity

Job description

Turing is seeking a detail-oriented QA Analyst to evaluate and compare chatbot outputs and assess them against defined guidelines. You will identify inaccuracies, gaps, and quality issues, providing clear final assessments for each evaluation task.

In this freelance, remote role, you will work with global teams to maintain consistency, document findings, and meet productivity and turnaround targets. Prior chatbot evaluation experience is a plus; strong communication and attention to detail are