LLM Quality Analyst | $30/hr Remote

Crossing Hurdles; United States; On-site; USD 55,000 - 90,000; Full time

Job summary

Crossing Hurdles is seeking a detail‑oriented reviewer to evaluate chatbot responses for accuracy, relevance, and clarity. You will identify inconsistencies and provide structured feedback, maintaining rigorous review records and documentation.

Collaboration with project and quality teams and escalation of ambiguous cases will be part of the role. Ideal candidates bring strong QA, data annotation, and content evaluation experience, plus excellent written and verbal communication skills.

Qualifications

• Experience in QA, data annotation, or content evaluation.
• Strong analytical, critical-thinking and problem solving skills.
• Excellent written and verbal communication abilities.
• Sharp attention to detail and ability to spot subtle errors.
• Familiarity with AI tools, chatbots and online platforms.

Responsibilities

• Evaluate and compare chatbot responses for accuracy, relevance, and clarity.
• Identify inconsistencies and provide structured feedback.
• Maintain consistent reviews and documentation.
• Collaborate with project and quality teams and escalate ambiguous cases.

Skills

Quality assurance

Data annotation

Content evaluation

Analytical thinking

Problem solving

Communication skills

Attention to detail

AI tools

Chatbots

Online platforms

Job description

• Evaluate and compare chatbot responses for accuracy, relevance, and clarity.
• Identify inconsistencies and provide structured feedback.
• Maintain consistent reviews and documentation.
• Collaborate with project and quality teams and **escalate ambiguous cases**.

Requirements

• Strong relevant experience in quality assurance, data annotation, or content evaluation.
• Strong analytical, critical-thinking, and problem-solving skills.
• Excellent written and verbal communication skills.
• Strong attention to detail and ability to identify subtle errors.
• Comfort with AI tools, chatbots, and online platforms.