Data Evaluation Analyst | $30/hr Remote

Crossing Hurdles; United States; On-site; USD 30,000 - 47,000; Full time

Job summary

Crossing Hurdles is seeking a QA reviews specialist to evaluate chatbot responses for accuracy, relevance, and clarity. The role focuses on identifying inconsistencies and providing structured feedback while maintaining thorough reviews and documentation.

Collaboration with project and quality teams is essential, including escalation of ambiguous cases to ensure quality standards. The ideal candidate has strong QA, data annotation or content evaluation experience, excellent communication skills,

Qualifications

• Experience in quality assurance, data annotation, or content evaluation.
• Strong analytical, critical-thinking and problem-solving abilities.
• Excellent written and verbal communication skills.
• Attention to detail with ability to identify subtle errors.
• Comfort using AI tools, chatbots and online platforms.

Responsibilities

• Evaluate and compare chatbot responses for accuracy, relevance and clarity.
• Identify inconsistencies and provide structured feedback.
• Maintain consistent reviews and documentation.
• Collaborate with project and quality teams and escalate ambiguous cases.

Skills

Quality assurance

Data annotation

Content evaluation

Analytical thinking

Critical thinking

Problem solving

Written communication

Verbal communication

Attention to detail

AI tools

Tools

AI tools

Chatbots

Online platforms

Job description

• Evaluate and compare chatbot responses for accuracy, relevance, and clarity.
• Identify inconsistencies and provide structured feedback.
• Maintain consistent reviews and documentation.
• Collaborate with project and quality teams and **escalate ambiguous cases**.

Requirements

• Strong relevant experience in quality assurance, data annotation, or content evaluation.
• Strong analytical, critical-thinking, and problem-solving skills.
• Excellent written and verbal communication skills.
• Strong attention to detail and ability to identify subtle errors.
• Comfort with AI tools, chatbots, and online platforms.