Search Quality Evaluator

Alignerr; South Africa; On-site; ZAR 14,000 - 55,000; Full time

Job summary

Alignerr is seeking a Search Quality Evaluator to help shape AI-powered search for millions of users. This fully remote, hourly contract role requires you to review AI-generated results, assess relevance, and provide clear written feedback using structured rubrics.

You will work 10–40 hours per week, choosing tasks that fit your schedule and pace, with no specialized AI background needed. Strong English writing and thoughtful analysis are essential.

Qualifications

• Excellent written English.
• Ability to assess content relevance and quality objectively.
• Strong judgment and careful, methodical approach to evaluation.

Responsibilities

• Evaluate search results for relevance, accuracy, and usefulness to real users.
• Rate AI-generated answers and content recommendations using structured rubrics.
• Compare multiple search results and rank them by quality and appropriateness.
• Provide clear, concise written explanations to support your ratings.
• Work through task-based assignments independently at your own pace and schedule.

Skills

English writing

Attention to detail

Independent work

Job description

What if your everyday internet savvy could directly influence how AI search systems work for millions of people? We're looking for Search Quality Evaluators to assess AI-generated search results, recommendations, and answers — helping ensure that the information people find online is accurate, relevant, and genuinely useful.

Search Quality Evaluator (AI Training)

What if your everyday internet savvy could directly influence how AI search systems work for millions of people? We're looking for Search Quality Evaluators to assess AI-generated search results, recommendations, and answers — helping ensure that the information people find online is accurate, relevant, and genuinely useful.

This is a fully remote, flexible contract role open to anyone who uses the internet regularly and has a sharp eye for quality. No technical or AI background required — just clear thinking, good judgment, and a reliable internet connection.

• Organization: Alignerr
• Type: Hourly Contract
• Location: Remote
• Commitment: 10–40 hours/week

What You'll Do

• Evaluate search results for relevance, accuracy, and overall usefulness to real users
• Rate AI-generated answers and content recommendations using structured evaluation rubrics
• Compare multiple search results and rank them by quality and appropriateness
• Provide clear, concise written explanations to support your ratings
• Work through task-based assignments independently at your own pace and schedule

Who You Are

• Comfortable using search engines and navigating the web with confidence
• Able to assess content relevance and quality objectively and consistently
• Detail-oriented with a systematic, thoughtful approach to evaluation
• Strong written communication skills in English
• Self-motivated and reliable when working independently
• No technical, AI, or professional research background required

Nice to Have

• Background in research, journalism, writing, editing, or information science
• Experience with quality assurance, content review, or critical analysis

  Why Join Us

  • Work on cutting-edge AI projects alongside leading research labs
  • Fully remote and flexible — work when and where it suits you
  • Freelance autonomy with the structure of meaningful, task-based work
  • Contribute directly to improving how AI surfaces information for people worldwide
  • Potential for ongoing work and contract extension as new projects launch