Quality Analyst (Chatbot Evaluation) · Turing Turing · Varies · remote in US · 9h ago Varies remote in US 9h ago

Benture; United States; Remote; USD 39,000 - 55,000; Part time

Benefits offered by this job

Fully remote

Flexible work environment

Global project exposure

Job summary

Turing, an AI company, is seeking a meticulous Quality Analyst for a 16-week contract to evaluate and compare chatbot responses. You will review outputs against guidelines, identify inaccuracies, and provide a clear final assessment for each task.

Join a remote US-based project team to collaborate with quality and project groups, meet productivity targets, and escalate complex cases when needed. This role focuses on data-quality and AI tool usage throughout the evaluation process.

Qualifications

• Experience in Quality Assurance, data annotation, content evaluation, testing, or a similar role.
• Strong analytical, critical-thinking, and problem-solving skills.
• Excellent written and verbal communication skills.
• High attention to detail and ability to identify subtle errors.
• Comfortable working with AI tools, chatbots, and online platforms.
• Prior experience with chatbot evaluation, LLM testing, or data-quality projects is an advantage.

Responsibilities

• Evaluate and compare responses generated by multiple chatbots.
• Assess responses for accuracy, relevance, completeness, clarity, and adherence to guidelines.
• Identify errors, inconsistencies, missing information, and potential quality issues.
• Provide structured feedback and final assessments for each task.
• Follow evaluation guidelines and maintain consistency across all reviews.
• Document findings clearly and accurately.
• Collaborate with project and quality teams to resolve queries.
• Meet assigned productivity, quality, and turnaround-time targets.
• Escalate complex or ambiguous cases when necessary.

Skills

Quality Assurance

Data annotation

Content evaluation

Analytical thinking

Communication

AI tools / chatbots

Job description

Quality Analyst (Contract) | Pay: Varies | Remote (US) | 16-week project

About the Role

Turing, an AI company working with leading AI labs and enterprises, is looking for a detail-oriented Quality Analyst to evaluate and compare responses generated by multiple chatbots. You will review outputs against defined guidelines, identify inaccuracies or quality issues, and provide a clear final assessment for each evaluation task.

What You'll Do

• Evaluate and compare responses generated by multiple chatbots.
• Assess responses for accuracy, relevance, completeness, clarity, and adherence to guidelines.
• Identify errors, inconsistencies, missing information, and potential quality issues.
• Provide structured feedback and final assessments for each task.
• Follow evaluation guidelines and maintain consistency across all reviews.
• Document findings clearly and accurately.
• Collaborate with project and quality teams to resolve queries.
• Meet assigned productivity, quality, and turnaround-time targets.
• Escalate complex or ambiguous cases when necessary.

Requirements

• Experience in Quality Assurance, data annotation, content evaluation, testing, or a similar role.
• Strong analytical, critical-thinking, and problem-solving skills.
• Excellent written and verbal communication skills.
• High attention to detail and ability to identify subtle errors.
• Comfortable working with AI tools, chatbots, and online platforms.
• Prior experience with chatbot evaluation, LLM testing, or data-quality projects is an advantage.

Schedule and Duration

• Project-based role involving a defined number of evaluation tasks.
• Duration: 16 weeks.
• Five working days per week, including weekends as required, with two weekdays off.

What Turing Offers

• Fully remote and flexible work environment.
• Opportunity to collaborate on high-impact projects with global reach.
• Work at the forefront of AI applications.