Quality Analyst · Turing Turing · Varies · Remote (outside US) · 4d ago Varies Remote (outside US) 4d ago

Benture; United States; Remote; USD 28,000 - 55,000; Part time

Job summary

Turing, an AI company, is seeking a detail-oriented Quality Analyst to evaluate and compare responses generated by multiple chatbots. The role is contractor, remote, and open to applicants outside the United States.

You will review outputs against guidelines, identify inaccuracies, and provide final assessments for each task. Responsibilities include evaluating chatbot responses for accuracy and clarity, documenting findings, and collaborating with quality teams to resolve queries while meeting

Qualifications

• Experience in QA, data annotation, content evaluation, testing, or a similar role.
• Strong analytical, critical-thinking, and problem-solving skills.
• Excellent written and verbal communication skills.
• High attention to detail and ability to identify subtle errors.
• Ability to follow detailed instructions and evaluation guidelines.
• Comfortable working with AI tools, chatbots, and online platforms.
• Ability to work independently and manage multiple tasks.
• Prior experience with chatbot evaluation, LLM testing, or data-quality projects is an advantage.

Responsibilities

• Evaluate and compare responses generated by multiple chatbots.
• Assess responses for accuracy, relevance, completeness, clarity, and adherence to guidelines.
• Identify errors, inconsistencies, missing information, and potential quality issues.
• Provide structured feedback and final assessments for each task.
• Follow evaluation guidelines and maintain consistency across all reviews.
• Document findings clearly and accurately.
• Collaborate with project and quality teams to resolve queries.
• Meet assigned productivity, quality, and turnaround-time targets.
• Escalate complex or ambiguous cases when necessary.

Skills

Quality Assurance

Data Annotation

Content Evaluation

Testing

Analytical Thinking

Problem Solving

Written Communication

Verbal Communication

Attention to Detail

Independent Work

Job description

Quality Analyst (AI Chatbot Evaluation) | Contractor | Remote, outside the US

Turing, an AI company that works with leading AI labs and builds real-world AI systems, is hiring a detail-oriented Quality Analyst to evaluate and compare responses generated by multiple chatbots. You will review outputs against defined guidelines, identify inaccuracies or quality issues, and provide a clear final assessment for each evaluation task.

What the work involves

• Evaluate and compare responses generated by multiple chatbots.
• Assess responses for accuracy, relevance, completeness, clarity, and adherence to guidelines.
• Identify errors, inconsistencies, missing information, and potential quality issues.
• Provide structured feedback and final assessments for each task.
• Follow evaluation guidelines and maintain consistency across all reviews.
• Document findings clearly and accurately.
• Collaborate with project and quality teams to resolve queries.
• Meet assigned productivity, quality, and turnaround-time targets.
• Escalate complex or ambiguous cases when necessary.

Who it's for

• Experience in Quality Assurance, data annotation, content evaluation, testing, or a similar role.
• Strong analytical, critical-thinking, and problem-solving skills.
• Excellent written and verbal communication skills.
• High attention to detail and ability to identify subtle errors.
• Ability to follow detailed instructions and evaluation guidelines.
• Comfortable working with AI tools, chatbots, and online platforms.
• Ability to work independently and manage multiple tasks.
• Prior experience with chatbot evaluation, LLM testing, or data-quality projects is an advantage.

Offer details and schedule

• Project-based role involving a defined number of evaluation tasks, each comparing multiple chatbot responses and providing a final assessment.
• Duration: 16 weeks.
• Schedule: five working days per week, including weekends as required, with two weekdays off.

Location

This role is remote and open to applicants outside the United States. The work environment is fully remote and flexible, with opportunities to collaborate on high-impact projects with global reach.