AI Output Quality Evaluator — Remote, Flexible Contract

Alignerr Corp.; Portugal; Remote; EUR 17,000 - 30,000; Part time

Benefits offered by this job

Fully remote

Flexible hours

Potential for ongoing work

Freelance autonomy

Job summary

Alignerr is seeking detail-oriented evaluators to review and rate AI-generated outputs, helping top research labs build smarter AI. This is a fully remote hourly contract open to people from all backgrounds.

If you have strong analytical thinking and a sharp eye for quality, we want to hear from you. You will review responses across text, image, and structured data, rate content quality using rubrics, provide detailed feedback, and work independently for 10–40 hours per week.

Qualifications

• Detail-oriented, analytical mindset, and strong critical thinking.
• Comfortable reading, evaluating, and giving structured feedback on written content.
• Able to work independently and meet deadlines.

Responsibilities

• Review AI-generated responses across text, image, and structured data formats for accuracy and relevance.
• Rate content quality using clear, structured rubrics and evaluation guidelines.
• Identify factual errors, inconsistencies, and areas where AI responses fall short.
• Provide detailed, well-documented feedback guiding model improvement.
• Work across diverse topics and content types.

Skills

Analytical thinking

Attention to detail

Written English

Independent work

Tools

Rubrics

Job description

Alignerr is seeking detail-oriented evaluators to review and rate AI-generated outputs, helping top research labs build smarter AI. This is a fully remote hourly contract open to people from all backgrounds.

If you have strong analytical thinking and a sharp eye for quality, we want to hear from you. You will review responses across text, image, and structured data, rate content quality using rubrics, provide detailed feedback, and work independently for 10–40 hours per week.