Remote AI Training Annotator & Evaluator (Paid Tasks)

prolificacademicltd; United States; Remote; USD 28,000 - 41,000; Full time

Job summary

Prolific Academic Ltd seeks contributors for a paid participant programme that trains and benchmarks cutting-edge AI systems. This is a fully remote, self-employed role built around discrete tasks sourced from real research projects.

Contributors act as the human feedback layer to improve model accuracy and alignment. Tasks are short, up to one hour, with researchers providing detailed instructions and pay rates typically around $25 per hour per completed task. onboarding is quick.

Qualifications

• Verifiable background as an AI trainer, annotator, or evaluator.
• Ability to complete a brief skills verification test of 10–15 minutes.
• Strong attention to detail and comfort with nuanced material.

Responsibilities

• Carry out AI training tasks involving analysis, editing, and annotation.
• Evaluate AI-generated responses and judge model performance on prompts.
• Provide consistent, well-reasoned input to improve AI models.
• Maintain concentration during tasks up to one hour.
• Follow detailed task instructions to maintain data integrity.

Skills

AI training

AI annotation

Model evaluation

Job description

Prolific Academic Ltd seeks contributors for a paid participant programme that trains and benchmarks cutting-edge AI systems. This is a fully remote, self-employed role built around discrete tasks sourced from real research projects.

Contributors act as the human feedback layer to improve model accuracy and alignment. Tasks are short, up to one hour, with researchers providing detailed instructions and pay rates typically around $25 per hour per completed task. onboarding is quick.