Search Quality Evaluator

Alignerr Corp.; Colombia; Remote; COP 52,615,000 - 109,615,000; Part time

Job summary

Alignerr is seeking a detail-oriented Search Quality Evaluator to help improve AI-driven search results. This fully remote, hourly contract role offers 10-40 hours per week and flexible scheduling. You will assess relevance and accuracy of results, rate AI-generated answers, and provide concise written feedback in English.

No technical background required; strong judgment and reliability are key as you work independently on diverse topics—from everyday queries to science and culture.

Qualifications

• Ability to evaluate search results for relevance and accuracy.
• Provide clear, concise written explanations to support your ratings and decisions.
• Comfortable using search engines and navigating the web.

Responsibilities

• Evaluate search engine results for relevance, accuracy, and usefulness.
• Rate AI-generated answers and content recommendations using structured rubrics.
• Compare multiple search results and rank by quality and user value.
• Provide clear, concise written explanations to support ratings and decisions.
• Work through task-based assignments independently with flexible scheduling.
• Cover a wide range of topics from everyday queries to science, news, technology, and culture.

Job description

Search Quality Evaluator (AI Training)

What if your everyday web skills and critical thinking could directly influence how AI understands and delivers information to millions of people? We're looking for Search Quality Evaluators to assess search engine results, AI-generated answers, and content recommendations - helping ensure that the AI systems shaping how the world finds information are accurate, relevant, and genuinely useful.

About The Role

This is a fully remote, flexible contract role open to anyone with sharp judgment and strong attention to detail. No technical or AI background required - if you can navigate the web and think critically about what makes a good search result, you're already halfway there.

• Organization: Alignerr
• Type: Hourly Contract
• Location: Remote
• Commitment: 10-40 hours/week

What You'll Do

• Evaluate search engine results for relevance, accuracy, and overall usefulness
• Rate AI-generated answers and content recommendations using structured evaluation rubrics
• Compare multiple search results and rank them by quality and user value
• Provide clear, concise written explanations to support your ratings and decisions
• Work through task-based assignments independently, at your own pace and on your own schedule
• Cover a wide range of topics - from everyday queries to science, news, technology, and culture

Who You Are

• Comfortable using search engines and navigating the web with confidence
• Able to assess content relevance and quality objectively and consistently
• Detail-oriented with a systematic, methodical approach to evaluation tasks
• Clear and concise written communicator in English
• Self-motivated and reliable when working independently
• No technical, AI, or search industry experience required

Nice to Have

• Background in research, journalism, editing, library science, or communications
• Experience with quality assurance, content evaluation, or critical analysis
• Familiarity with AI tools, search platforms, or content rating systems as an end user
• Broad general knowledge across a variety of subject areas

Why Join Us

• Work on cutting-edge AI projects alongside leading research labs
• Fully remote and flexible - work when and where it suits you
• Freelance autonomy with the structure of meaningful, task-based work
• Make a direct, tangible impact on how AI finds and presents information to the world
• Potential for ongoing work and contract extension as new projects launch