Language Model Evaluator | $30/hr Remote

Crossing Hurdles; United States; On-site; USD 60,000 - 85,000; Full time

Job summary

Crossing Hurdles seeks a detail-oriented QA reviewer to evaluate chatbot outputs and ensure quality. You will assess responses for accuracy, relevance, and clarity, and contribute to the continuous improvement of guidance and tooling.

The role requires strong QA experience, excellent communication, and the ability to collaborate across project and quality teams. You will document findings and escalate ambiguous cases as needed.

Qualifications

• Experience in quality assurance, data annotation, or content evaluation.
• Strong analytical and problem-solving skills.
• Excellent written and verbal communication.

Responsibilities

• Evaluate and compare chatbot responses for accuracy and relevance.
• Identify inconsistencies and provide structured feedback.
• Maintain consistent reviews and documentation.
• Collaborate with project and quality teams, escalating ambiguous cases.

Skills

Quality assurance experience

Analytical thinking

Excellent communication

Attention to detail

Familiarity with AI tools

Tools

AI tools

Job description

• Evaluate and compare chatbot responses for accuracy, relevance, and clarity.
• Identify inconsistencies and provide structured feedback.
• Maintain consistent reviews and documentation.
• Collaborate with project and quality teams and **escalate ambiguous cases**.

Requirements

• Strong relevant experience in quality assurance, data annotation, or content evaluation.
• Strong analytical, critical-thinking, and problem-solving skills.
• Excellent written and verbal communication skills.
• Strong attention to detail and ability to identify subtle errors.
• Comfort with AI tools, chatbots, and online platforms.