AI Data Quality Analyst

Alignerr Corp.; Colombia; Remote; COP 34,644,000 - 69,287,000; Part time

Job summary

Alignerr is hiring for a remote, flexible contract role focused on reviewing and rating AI-generated outputs. You will assess accuracy across text, image, and structured data, and provide structured feedback to support model improvement.

The position offers 10–40 hours per week with fully remote work and asynchronous collaboration. You should be a keen reader with strong English writing skills, capable of self-managing deadlines and delivering clear evaluations that help top AI research labs

Qualifications

• Excellent reading and writing in English.
• Ability to evaluate content critically and objectively.
• Strong attention to detail and factual accuracy.

Responsibilities

• Review AI-generated responses across text, image, and structured data formats for accuracy and quality.
• Rate content using clear, structured rubrics and guidelines.
• Identify factual errors, inconsistencies, and areas where AI responses fall short.
• Provide well-documented, actionable feedback that informs model improvement.

Skills

Attention to detail

Critical reading

English writing

Time management

Self-motivation

Job description

About The Role

AI is only as good as the humans who evaluate it. We're looking for sharp, detail-oriented people to review and rate AI-generated outputs — helping some of the world's leading AI research labs build smarter, more accurate, and more reliable systems.

About The Role

AI is only as good as the humans who evaluate it. We're looking for sharp, detail-oriented people to review and rate AI-generated outputs — helping some of the world's leading AI research labs build smarter, more accurate, and more reliable systems.

This is a fully remote, flexible contract role. You choose when you work, how much you take on, and you'll be contributing to technology that's genuinely shaping the future.

• Organization: Alignerr
• Type: Hourly Contract
• Location: Remote
• Commitment: 10–40 hours/week

What You'll Do

• Review AI-generated responses across text, image, and structured data formats for accuracy and quality
• Rate content using clear, structured rubrics and guidelines
• Identify factual errors, inconsistencies, and areas where AI responses fall short
• Provide well-documented, actionable feedback that directly informs model improvement
• Work across a diverse range of topics and content types — no two days are the same

Who You Are

• You have a sharp eye for detail and notice things others miss
• You're a strong reader and can evaluate written content critically and objectively
• You communicate clearly in English — written feedback is a core part of the job
• You're self-motivated and comfortable managing your own time and deadlines
• You're curious, thorough, and take quality seriously

No prior AI or technical experience required

— if you can read carefully and think critically, you're already qualified.

Nice to Have

• Background in writing, editing, research, journalism, or academia
• Experience with structured evaluation, annotation, or quality assurance
• Familiarity with AI tools or language model outputs

Why Join Us

• Fully remote — work from anywhere, on your schedule
• Flexible hours — take on as much or as little as fits your life
• Meaningful work — your feedback directly improves AI systems used by millions
• Cutting-edge projects — collaborate with top AI research labs on the frontier of the field
• Variety — work across a wide range of topics, formats, and content types
• Autonomy — freelance freedom with real, substantive work to sink your teeth into
• Ongoing opportunity — strong performers are considered for contract extensions and new projects