Content Evaluator | $70/hr Remote

Crossing Hurdles; Ireland; On-site; EUR 32,000 - 46,000; Full time

Job summary

Crossing Hurdles is seeking an AI evaluation specialist in Ireland to review and critically assess AI-generated outputs for quality, clarity, usability, and user experience.

The role requires native English proficiency at C1/C2, exceptional reading comprehension, and strong editorial judgment, with a focus on delivering accurate, actionable feedback to improve models. Collaboration with cross-functional teams is essential.

Qualifications

• Native English proficiency at C1 or C2 level.
• Exceptional reading comprehension and acute attention to detail.
• Demonstrate strong observational skills with excellent aesthetic or editorial judgment.
• Be able to think critically and deliver consistent, high-quality evaluations in ambiguous scenarios.
• Have excellent written and verbal communication skills.

Responsibilities

• Review and critically assess AI-generated outputs for quality, clarity, usability, and overall user experience.
• Identify inconsistencies, weaknesses, and improvement opportunities across diverse content types and visual experiences.
• Apply structured evaluation guidelines and provide insightful, nuanced feedback to inform model improvements.
• Collaborate with cross-functional teams to define and refine quality standards, scoring criteria, and review processes.
• Maintain high accuracy and consistency across evaluations, ensuring reliable and actionable results.
• Contribute to the continuous enhancement of evaluation workflows and best practices.

Skills

Native English

Reading comprehension

Attention to detail

Editorial judgment

Critical thinking

Written and verbal communication

Job description

• Review and critically assess AI-generated outputs for quality, clarity, usability, and overall user experience.
• Identify inconsistencies, weaknesses, and improvement opportunities across diverse content types and visual experiences.
• Apply structured evaluation guidelines and provide insightful, nuanced feedback to inform model improvements.
• Collaborate with cross-functional teams to define and refine quality standards, scoring criteria, and review processes.
• Maintain high accuracy and consistency across evaluations, ensuring reliable and actionable results.
• Contribute to the continuous enhancement of evaluation workflows and best practices.

Requirements

• Have native English proficiency at C1 or C2 level.
• Possess exceptional reading comprehension and acute attention to detail.
• Demonstrate strong observational skills with excellent aesthetic or editorial judgment.
• Be able to think critically and deliver consistent, high-quality evaluations in ambiguous scenarios.
• Have excellent written and verbal communication skills.

Application Process

• Easy Apply on LinkedIn
• Participate in resume evaluation & interview stage