Remote AI Content Reviewer & Prompt Evaluation

Crossing Hurdles; España; Remote; EUR 24,000 - 36,000; Full time

Job summary

Crossing Hurdles in Spain is seeking a detail-oriented evaluator to join our AI quality team. You will assess AI tool performance under standardized conditions, annotate model outputs, and help refine prompts to probe edge cases.

You will collaborate with teammates to ensure consistent guidelines, participate in training data submissions, and contribute to quality reviews that shape future evaluations and training standards.

Qualifications

• Exceptional attention to detail in evaluating AI-generated content.
• Strong written and verbal communication skills for collaboration.
• Demonstrated time management abilities for remote project participation.
• Analytical mindset with a proactive approach to evaluation challenges.
• Proven experience with AI model training or data labeling projects.
• Familiarity with AI products and tools, including prompt engineering.
• Experience writing evaluation rubrics or reviewing AI responses for accuracy.

Responsibilities

• Evaluate the performance of AI tools under standardized conditions.
• Apply grading guidelines to evaluate and annotate model responses.
• Write and refine prompts that probe model capabilities and edge cases.
• Verify consistency and accuracy across evaluations and ratings.
• Utilize training tools to submit evaluation datasets that meet standards.
• Collaborate with team members to refine guidelines and ensure consistency.
• Participate in quality reviews, incorporating feedback for training standards.

Skills

Attention to detail

Communication

Time management

Analytical mindset

AI data labeling

Prompt engineering

Evaluation rubrics

AI tools familiarity

Job description

Crossing Hurdles in Spain is seeking a detail-oriented evaluator to join our AI quality team. You will assess AI tool performance under standardized conditions, annotate model outputs, and help refine prompts to probe edge cases.

You will collaborate with teammates to ensure consistent guidelines, participate in training data submissions, and contribute to quality reviews that shape future evaluations and training standards.