Search Evaluator - Fully Remote

Mercor; Sydney; Remote; AUD 60,000 - 80,000; Part time

Job summary

Mercor is seeking a Search Generalist contractor to help evaluate AI model outputs through daily search tasks. Work is remote with flexible hours, making it suitable for candidates in Australia and beyond.

The role requires strong English writing, keen attention to detail, and the ability to judge page relevance as everyday web users. You will provide brief notes to support training data quality and meet daily deadlines.

Qualifications

• Must understand how to evaluate relevance as a daily web user.
• Excellent written English, with clear and concise notation.
• Careful, consistent, and detail-oriented.

Responsibilities

• Conduct daily search queries and rate results to improve AI model outputs.
• Complete assigned queries daily to ensure timely evaluation.
• Provide short notes and annotations to enhance training data quality.
• Work independently and asynchronously with flexible hours.

Skills

Web literacy

English proficiency

Attention to detail

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Search Generalist
Type: Contract
Compensation: $30–$40/hour
Location: Remote

Role Responsibilities

• Conduct daily search queries and rate the results to improve AI model outputs.
• Complete assigned queries each day to ensure timely evaluation.
• Provide short notes and annotations to enhance training data quality.
• Work independently and asynchronously to meet deadlines with flexible hours.

Qualifications

Must-Have

• Everyday web users who can judge page relevance.
• Strong written English skills.
• Careful, consistent, and detail-oriented.

Preferred

• Deep interest or expertise in specific areas, such as basketball or reality TV.
• Proficiency in other languages.

Resources & Support

• For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
• For any help or support, reach out to: [e-mail]