AI Search Ranking Quality Specialist

Globik AI; United States; Remote; USD 14,000 - 21,000; Full time

Job summary

Globik AI is seeking AI Search Ranking Quality Specialists to evaluate whether search systems place the most useful results in the right order.

The role focuses on ranking quality: comparing ordered results, identifying when weaker results appear above stronger ones, and recording judgments to help improve search-ranking systems.

Responsibilities include reviewing queries and result lists, assessing usefulness, identifying ranking errors, and participating in calibration and quality reviews.

Qualifications

• Experience in search evaluation content review QA research or AI evaluation is a plus.

Responsibilities

• Review search queries and ordered result lists.
• Assess whether higher-ranked results are more useful than lower-ranked results.
• Compare pairs or groups of results and identify ranking errors.
• Evaluate ranking based on relevance, usefulness, authority, freshness, and project criteria.
• Identify strong results that are ranked too low.
• Identify weak or irrelevant results that are ranked too high.
• Consider likely user intent when assessing ranking.
• Record structured judgments and explanations.
• Identify recurring ranking issues and edge cases.
• Participate in calibration and quality reviews.

Skills

Search evaluation

QA research

AI evaluation

Job description

Globik AI is seeking AI Search Ranking Quality Specialists to evaluate whether search systems place the most useful results in the right order.

The role focuses specifically on ranking quality: comparing ordered results, identifying when weaker results appear above stronger ones, and recording judgments that help improve search-ranking systems.

Responsibilities

• Review search queries and ordered result lists.
• Assess whether higher-ranked results are more useful than lower-ranked results.
• Compare pairs or groups of results and identify ranking errors.
• Evaluate ranking based on relevance, usefulness, authority, freshness, and project criteria.
• Identify strong results that are ranked too low.
• Identify weak or irrelevant results that are ranked too high.
• Consider likely user intent when assessing ranking.
• Record structured judgments and explanations.
• Identify recurring ranking issues and edge cases.
• Participate in calibration and quality reviews.

Qualifications

• Experience in search evaluation content review QA research or AI evaluation is a plus.

Pay

$10–$15/item