Remote AI Training & Evaluation Specialist

prolificacademicltd; United States; Remote; USD 28,000 - 41,000; Full time

Benefits offered by this job

Fully remote

Flexible schedule

Self-paced tasks

Onboarding after assessment

Job summary

prolificacademic ltd. is offering a fully remote, self-employed contributor role to participate in a paid AI training and benchmarking program.

You will complete discrete tasks drawn from real research projects, acting as the human feedback layer to improve model accuracy and alignment. Contributors perform annotations, evaluation, and editing tasks, with work arranged around individual assignments of up to one hour each.

Qualifications

• Verifiable professional background as an AI trainer, annotator, evaluator, or closely related role.
• Willingness to complete a brief skills verification test of about 10–15 minutes.
• Strong attention to detail and comfort working through nuanced, complex material.
• Reliable fast internet connection plus a suitable computer for remote work.
• Self-employed classification with a willingness to self-declare earnings.
• A PayPal account for receiving payments from research clients.

Responsibilities

• Carry out AI training tasks involving the analysis, editing, and authoring of annotations
• Evaluate AI-generated responses and judge overall model performance on varied prompts
• Provide consistent, well-reasoned input that contributes to ongoing AI model improvements
• Maintain sustained concentration during individual tasks lasting up to one hour
• Follow detailed task instructions supplied by researchers to maintain data integrity

Skills

AI trainer

Annotator

Evaluator

Job description

prolificacademic ltd. is offering a fully remote, self-employed contributor role to participate in a paid AI training and benchmarking program.

You will complete discrete tasks drawn from real research projects, acting as the human feedback layer to improve model accuracy and alignment. Contributors perform annotations, evaluation, and editing tasks, with work arranged around individual assignments of up to one hour each.