Remote Part-Time Data Labeling & Ranking Specialist

Mercor; Remote; CAD 80,000 - 100,000; Part time

Job summary

A talent marketplace for AI projects seeks detail-oriented generalists for data labeling and content evaluation in a remote setting. Responsibilities include evaluating AI responses and assigning preference rankings. Ideal candidates have prior experience in similar tasks, strong critical thinking skills, and attention to detail. Flexible part-time commitment of 10–20 hours/week is expected. Competitive pay ranges from $25–35/hour depending on experience.

Qualifications

• Prior experience in data labeling, content moderation, or preference ranking tasks.
• Excellent critical thinking and reading comprehension skills.
• Strong attention to detail and consistency across repetitive tasks.
• Comfort working with evolving guidelines and ambiguity.

Responsibilities

• Evaluate and compare AI-generated responses based on quality, coherence, and helpfulness.
• Assign preference rankings to pairs or sets of model outputs.
• Provide brief written explanations for ranking decisions when required.
• Flag edge cases or inconsistencies in task design or model output.

Skills

Critical thinking

Reading comprehension

Attention to detail

Ability to handle ambiguity

Data labeling or content evaluation experience

Job description

A talent marketplace for AI projects seeks detail-oriented generalists for data labeling and content evaluation in a remote setting. Responsibilities include evaluating AI responses and assigning preference rankings. Ideal candidates have prior experience in similar tasks, strong critical thinking skills, and attention to detail. Flexible part-time commitment of 10–20 hours/week is expected. Competitive pay ranges from $25–35/hour depending on experience.