AI Content Quality Evaluator

Crossing Hurdles; Ireland; On-site; EUR 32,000 - 46,000; Full time

Job summary

Crossing Hurdles is seeking an AI evaluation specialist in Ireland to review and critically assess AI-generated outputs for quality, clarity, usability, and user experience.

The role requires native English proficiency at C1/C2, exceptional reading comprehension, and strong editorial judgment, with a focus on delivering accurate, actionable feedback to improve models. Collaboration with cross-functional teams is essential.

Qualifications

• Native English proficiency at C1 or C2 level.
• Exceptional reading comprehension and acute attention to detail.
• Demonstrate strong observational skills with excellent aesthetic or editorial judgment.
• Be able to think critically and deliver consistent, high-quality evaluations in ambiguous scenarios.
• Have excellent written and verbal communication skills.

Responsibilities

• Review and critically assess AI-generated outputs for quality, clarity, usability, and overall user experience.
• Identify inconsistencies, weaknesses, and improvement opportunities across diverse content types and visual experiences.
• Apply structured evaluation guidelines and provide insightful, nuanced feedback to inform model improvements.
• Collaborate with cross-functional teams to define and refine quality standards, scoring criteria, and review processes.
• Maintain high accuracy and consistency across evaluations, ensuring reliable and actionable results.
• Contribute to the continuous enhancement of evaluation workflows and best practices.

Skills

Native English

Reading comprehension

Attention to detail

Editorial judgment

Critical thinking

Written and verbal communication

Job description

Crossing Hurdles is seeking an AI evaluation specialist in Ireland to review and critically assess AI-generated outputs for quality, clarity, usability, and user experience.

The role requires native English proficiency at C1/C2, exceptional reading comprehension, and strong editorial judgment, with a focus on delivering accurate, actionable feedback to improve models. Collaboration with cross-functional teams is essential.