Search Quality Evaluator

Alignerr Corp.; Colombia; Remote; COP 52,868,000 - 88,113,000; Part time

Job summary

Alignerr is seeking a Search Quality Evaluator (AI Training) to assess search engine results, AI-generated answers, and content recommendations. This is a fully remote, flexible hourly contract open to anyone with sharp judgment and attention to detail.

You will evaluate relevance, rate AI outputs using rubrics, and provide clear written explanations. No technical background required; if you can navigate the web critically, you're a strong fit.

Qualifications

• Ability to evaluate search results for relevance and quality.
• Excellent written communication in English.
• Detail-oriented with a methodical evaluation approach.

Responsibilities

• Evaluate search results for relevance and usefulness.
• Rate AI-generated answers and content recommendations.
• Explain ratings clearly and concisely in writing.
• Work independently with flexible schedule.

Skills

Detail-oriented

Written English

Independent worker

Critical thinking

Job description

About The Role

What if your everyday web skills and critical thinking could directly influence how AI understands and delivers information to millions of people? We're looking for Search Quality Evaluators to assess search engine results, AI-generated answers, and content recommendations - helping ensure that the AI systems shaping how the world finds information are accurate, relevant, and genuinely useful.

Search Quality Evaluator (AI Training)

About The Role

What if your everyday web skills and critical thinking could directly influence how AI understands and delivers information to millions of people? We're looking for Search Quality Evaluators to assess search engine results, AI-generated answers, and content recommendations - helping ensure that the AI systems shaping how the world finds information are accurate, relevant, and genuinely useful.

This is a fully remote, flexible contract role open to anyone with sharp judgment and strong attention to detail. No technical or AI background required - if you can navigate the web and think critically about what makes a good search result, you're already halfway there.

• Organization: Alignerr
• Type: Hourly Contract
• Location: Remote
• Commitment: 10-40 hours/week

What You'll Do

• Evaluate search engine results for relevance, accuracy, and overall usefulness
• Rate AI-generated answers and content recommendations using structured evaluation rubrics
• Compare multiple search results and rank them by quality and user value
• Provide clear, concise written explanations to support your ratings and decisions
• Work through task-based assignments independently, at your own pace and on your own schedule
• Cover a wide range of topics - from everyday queries to science, news, technology, and culture

Who You Are

• Comfortable using search engines and navigating the web with confidence
• Able to assess content relevance and quality objectively and consistently
• Detail-oriented with a systematic, methodical approach to evaluation tasks
• Clear and concise written communicator in English
• Self-motivated and reliable when working independently
• No technical, AI, or search industry experience required

Nice to Have

• Background in research, journalism, editing, library science, or communications
• Experience with quality assurance, content evaluation, or critical analysis
• Familiarity with AI tools, search platforms, or content rating systems as an end user
• Broad general knowledge across a variety of subject areas

Why Join Us

• Work on cutting-edge AI projects alongside leading research labs
• Fully remote and flexible - work when and where it suits you
• Freelance autonomy with the structure of meaningful, task-based work
• Make a direct, tangible impact on how AI finds and presents information to the world
• Potential for ongoing work and contract extension as new projects launch