Search Quality Evaluator

Alignerr; España; Remote; EUR 12,000 - 21,000; Full time

Job summary

Alignerr is seeking a Search Quality Evaluator (AI Training) to help shape how AI systems present information to millions of users. This fully remote role offers a flexible schedule and an hourly commitment of 10–40 hours per week, enabling you to work when it suits you.

You will evaluate search results, rate AI-generated answers, and provide clear written explanations to support your ratings. A strong command of English and a detail-oriented, systematic approach are essential; no prior AI

Qualifications

• Comfortable using search engines and navigating the web.
• Able to assess content relevance and quality objectively.
• Detail-oriented with a methodical evaluation approach.
• Clear and concise written communication in English.
• Self-motivated and reliable for independent work.
• No technical AI or prior evaluation experience required.

Responsibilities

• Evaluate search results for relevance, accuracy, and usefulness.
• Rate AI-generated answers and content recommendations using rubrics.
• Compare multiple results side by side and rank them by quality.
• Provide clear, concise written explanations to support ratings.
• Work through task-based batches independently, at your own pace and on your own schedule.

Skills

Attention to detail

Written English

Self-motivated

Independent work

Education

Research/Information science background

Job description

About The RoleWhat if your everyday web browsing habits and critical eye could directly influence how AI systems find and present information to millions of people? We're looking for Search Quality Evaluators to assess search engine results, AI-generated answers, and content recommendations — helping ensure that AI delivers results that are accurate, relevant, and genuinely useful.

Search Quality Evaluator (AI Training)

About The RoleWhat if your everyday web browsing habits and critical eye could directly influence how AI systems find and present information to millions of people? We're looking for Search Quality Evaluators to assess search engine results, AI-generated answers, and content recommendations — helping ensure that AI delivers results that are accurate, relevant, and genuinely useful.

• Organization: Alignerr
• Type: Hourly Contract
• Location: Remote
• Commitment: 10–40 hours/week

What You’ll Do

• Evaluate search engine results for relevance, accuracy, and overall usefulness
• Rate AI-generated answers and content recommendations using structured evaluation rubrics
• Compare multiple results side by side and rank them by quality
• Provide clear, concise written explanations to support your ratings
• Work through task-based batches independently, at your own pace and on your own schedule

Who You Are

• Comfortable using search engines and navigating the web with confidence
• Able to assess content relevance and quality objectively and consistently
• Detail-oriented with a systematic, methodical approach to evaluation
• Clear and concise written communicator in English
• Self-motivated and reliable when working independently
• No technical, AI, or prior evaluation experience required

Nice to Have

• Background in research, journalism, editing, or information science
• Experience with quality assurance, critical analysis, or content review
• Familiarity with AI tools, search platforms, or recommendation systems as an end user
• Broad general knowledge across a wide range of topics

Why Join Us

• Work on cutting-edge AI projects alongside leading research labs
• Fully remote and flexible — work when and where it suits you
• Freelance autonomy with the structure of meaningful, task-based work
• Contribute to AI development that directly shapes how technology finds and presents information
• Potential for ongoing work and contract extension as new projects launch