AI Evaluation Specialist — Remote, High-Impact

Prolific; Birmingham; Remote; GBP 51,000 - 72,000; Full time

Job summary

Prolific invites Computer Science graduates to join its Expert Network to help train and evaluate cutting‑edge AI models. After a quick 10‑ to 15‑minute test, you may be invited to participate and get paid for helping AI understand and summarize complex scientific data.

Researchers looking for your skills tend to be paid up to $60/hr, depending on skills and experience level. You must be prepared to complete paid tasks that require one hour of uninterrupted work, though many are shorter.

Qualifications

• Minimum BSc in Computer Science or related field.
• Ability to interpret research papers and algorithms.
• Skill in reviewing code logic and spotting flaws.
• Professional verification via a valid LinkedIn profile.
• PayPal account to receive payment.

Responsibilities

• AI Evaluation & Ranking: compare AI responses and rank by accuracy, logic, and safety.
• Scientific Review: review CS papers with AI summaries for integrity.
• Fact-Checking: identify inaccuracies where AI misinterprets data.
• RLHF: provide human ground truth to align models with standards in software engineering and data science.
• Code & Logic Verification: audit AI-generated code snippets and diagrams for correctness.

Skills

Interpreting research papers

Understanding complex algorithms

Review code logic

Professional verification

PayPal for payments

Education

BSc in Computer Science

Job description

Prolific invites Computer Science graduates to join its Expert Network to help train and evaluate cutting‑edge AI models. After a quick 10‑ to 15‑minute test, you may be invited to participate and get paid for helping AI understand and summarize complex scientific data.

Researchers looking for your skills tend to be paid up to $60/hr, depending on skills and experience level. You must be prepared to complete paid tasks that require one hour of uninterrupted work, though many are shorter.