Search Quality Evaluator

Alignerr Corp.; Canada; Remote; CAD 21,000 - 30,000; Full time

Job summary

Alignerr is seeking a Search Quality Evaluator for AI training to assess AI-generated answers, search results, and recommendations, ensuring accuracy, relevance, and usefulness in information access.

This fully remote hourly contract offers 10–40 hours per week with no technical background required, allowing you to work on your own schedule and contribute to cutting-edge AI projects.

Qualifications

• Strong critical thinking and judgment to assess AI-generated content.
• Detail-oriented with a methodical approach to evaluation tasks.
• Clear written communication in English.
• Ability to work remotely and manage schedule independently.

Responsibilities

• Evaluate search engine results for relevance, accuracy, and usefulness.
• Rate AI-generated answers and recommendations using structured rubrics.
• Compare multiple results side by side and rank them by quality.
• Provide clear, concise written explanations to support your ratings.
• Work through task-based assignments independently at your own pace and on your own schedule.

Skills

Critical thinking

Attention to detail

Written communication

Independent work

Job description

About The Role

What if your everyday curiosity and sharp judgment could directly influence how millions of people find information online? We're looking for Search Quality Evaluators to assess AI-generated answers, search results, and recommendations — helping ensure that the AI systems shaping how the world accesses knowledge are accurate, relevant, and genuinely useful.

Search Quality Evaluator (AI Training)

This is a fully remote, flexible contract role open to anyone with strong critical thinking and a keen eye for quality. No technical or AI background required — just a reliable internet connection, good judgment, and a commitment to doing thoughtful work.

• Organization: Alignerr
• Type: Hourly Contract
• Location: Remote
• Commitment: 10–40 hours/week

What You'll Do

• Evaluate search engine results for relevance, accuracy, and overall usefulness
• Rate AI-generated answers and recommendations using structured evaluation rubrics
• Compare multiple results side by side and rank them by quality
• Provide clear, concise written explanations to support your ratings
• Work through task-based assignments independently at your own pace and on your own schedule

Who You Are

• Comfortable using search engines and navigating the web with confidence
• Able to assess content relevance and quality objectively and consistently
• Naturally detail-oriented with a methodical approach to evaluation tasks
• Clear and concise written communicator in English
• Self-motivated and reliable when working independently
• No prior AI, tech, or research experience required

Nice to Have

• Background in research, journalism, education, or content analysis
• Experience with quality assurance, data review, or critical evaluation work
• Familiarity with AI tools or search platforms as an everyday user
• Broad general knowledge across a variety of topics and subject areas

Why Join Us

• Work on cutting-edge AI projects alongside leading research labs
• Fully remote and flexible — work when and where it suits you
• Freelance autonomy with the structure of meaningful, task-based work
• Contribute directly to AI development that shapes how technology connects people with information
• Potential for ongoing work and contract extension as new projects launch