AI Data Quality Analyst

Alignerr; Portugal; Remote; EUR 17,000 - 30,000; Part time

Benefits offered by this job

Fully remote

Flexible hours

Potential for ongoing work

Freelance autonomy

Job summary

Alignerr is seeking detail-oriented evaluators to review and rate AI-generated outputs, helping top research labs build smarter AI. This is a fully remote hourly contract open to people from all backgrounds.

If you have strong analytical thinking and a sharp eye for quality, we want to hear from you. You will review responses across text, image, and structured data, rate content quality using rubrics, provide detailed feedback, and work independently for 10–40 hours per week.

Qualifications

• Detail-oriented, analytical mindset, and strong critical thinking.
• Comfortable reading, evaluating, and giving structured feedback on written content.
• Able to work independently and meet deadlines.

Responsibilities

• Review AI-generated responses across text, image, and structured data formats for accuracy and relevance.
• Rate content quality using clear, structured rubrics and evaluation guidelines.
• Identify factual errors, inconsistencies, and areas where AI responses fall short.
• Provide detailed, well-documented feedback guiding model improvement.
• Work across diverse topics and content types.

Skills

Analytical thinking

Attention to detail

Written English

Independent work

Tools

Rubrics

Job description

About The Role

AI is only as good as the humans who evaluate it. We're looking for detail-oriented individuals to review and rate AI-generated outputs — helping top research labs build smarter, more accurate, and more reliable AI systems.

About The Role

AI is only as good as the humans who evaluate it. We're looking for detail-oriented individuals to review and rate AI-generated outputs — helping top research labs build smarter, more accurate, and more reliable AI systems.

This is a fully remote, flexible contract role open to people from all backgrounds. If you have strong analytical thinking and a sharp eye for quality, we want to hear from you.

• Organization: Alignerr
• Type: Hourly Contract
• Location: Remote
• Commitment: 10–40 hours/week

What You'll Do

• Review AI-generated responses across text, image, and structured data formats for accuracy and relevance
• Rate content quality using clear, structured rubrics and evaluation guidelines
• Identify factual errors, inconsistencies, and areas where AI responses fall short
• Provide detailed, well-documented feedback that directly guides model improvement
• Work across a diverse range of topics and content types

Who You Are

• Sharp eye for detail with strong analytical and critical thinking skills
• Comfortable reading, evaluating, and giving structured feedback on written content
• Self-motivated and able to work independently and meet deadlines
• Clear and precise written communication in English
• No prior AI or technical experience required — if you can think critically and communicate clearly, you're qualified

Nice to Have

• Background in research, writing, editing, journalism, or quality assurance
• Experience following detailed guidelines or rubrics
• Familiarity with AI tools or language model outputs

Why Join Us

• Work on meaningful projects — your feedback directly improves AI used by millions
• Fully remote — work from anywhere, on your own schedule
• Flexible hours — choose 10 to 40 hours per week to fit your life
• Variety — no two days are the same; work spans science, culture, technology, and more
• Freelance autonomy — be your own boss with the support of a global team
• Potential for ongoing work — strong performers are considered for contract extensions and new projects