Content Evaluator | $70/hr Remote

Crossing Hurdles; United Kingdom; On-site; GBP 35,000 - 52,000; Full time

Job summary

Crossing Hurdles is seeking a Quality Evaluation Specialist to review AI-generated outputs for quality, clarity, and usability. You will identify inconsistencies and opportunities for improvement, applying structured guidelines to deliver nuanced feedback for model improvements.

The role requires native English proficiency (C1/C2), excellent reading comprehension, sharp observational skills, and strong written and verbal communication to ensure high-quality evaluations in diverse scenarios.

Qualifications

• Native English proficiency at C1 or C2 level.
• Exceptional reading comprehension and acute attention to detail.
• Strong observational skills with excellent aesthetic or editorial judgment.
• Ability to think critically and deliver consistent, high-quality evaluations in ambiguous scenarios.
• Excellent written and verbal communication skills.

Responsibilities

• Review and critically assess AI-generated outputs for quality, clarity, usability, and user experience.
• Identify inconsistencies, weaknesses, and improvement opportunities across content types and visuals.
• Apply structured evaluation guidelines and provide insightful feedback for model improvements.
• Collaborate with cross-functional teams to define quality standards, scoring criteria, and review processes.
• Maintain high accuracy and consistency across evaluations, ensuring reliable results.
• Contribute to continuous enhancement of evaluation workflows and best practices.

Skills

English proficiency (C1/C2)

Reading comprehension

Attention to detail

Editorial judgment

Critical thinking

Written & verbal communication

Job description

• Review and critically assess AI-generated outputs for quality, clarity, usability, and overall user experience.
• Identify inconsistencies, weaknesses, and improvement opportunities across diverse content types and visual experiences.
• Apply structured evaluation guidelines and provide insightful, nuanced feedback to inform model improvements.
• Collaborate with cross-functional teams to define and refine quality standards, scoring criteria, and review processes.
• Maintain high accuracy and consistency across evaluations, ensuring reliable and actionable results.
• Contribute to the continuous enhancement of evaluation workflows and best practices.

Requirements

• Have native English proficiency at C1 or C2 level.
• Possess exceptional reading comprehension and acute attention to detail.
• Demonstrate strong observational skills with excellent aesthetic or editorial judgment.
• Be able to think critically and deliver consistent, high-quality evaluations in ambiguous scenarios.
• Have excellent written and verbal communication skills.