AI Training & Evaluation Specialist

Prolific; Coventry; Remote; GBP 37,000 - 62,000; Full time

Job summary

Prolific seeks Computer Science Specialists to join its Expert Network to help train and evaluate AI models. If successful, you’ll be invited to join Prolific as a participant, where you’ll be paid to assist AI in understanding and summarizing complex scientific data.

Applicants should hold a BSc in Computer Science or related field, with strong technical literacy and an analytical mindset, plus a verifiable LinkedIn profile.

Qualifications

• Educational background: BSc (Bachelor of Science) in Computer Science or closely related field.
• Technical literacy: ability to interpret research papers, understand complex algorithms, and review code logic.
• Analytical mindset: high level of cognitive competency with a sharp eye for technical accuracy.
• Professional verification: a valid LinkedIn profile to verify your degree and background during screening.
• PayPal account: to receive payment from clients.

Responsibilities

• AI Evaluation & Ranking: compare AI-generated responses and rank by accuracy, logic, and safety.
• Scientific Review: review CS research papers and AI-generated summaries for scientific integrity.
• Fact-Checking: identify inaccuracies where AI misinterprets data or findings.
• RLHF: provide human ground truth to help models align with professional standards.
• Code & Logic Verification: audit AI-generated code snippets and diagrams for correctness.

Skills

Analytical mindset

Technical literacy

Professional verification

PayPal payments

Education

BSc in Computer Science

Job description

Prolific seeks Computer Science Specialists to join its Expert Network to help train and evaluate AI models. If successful, you’ll be invited to join Prolific as a participant, where you’ll be paid to assist AI in understanding and summarizing complex scientific data.

Applicants should hold a BSc in Computer Science or related field, with strong technical literacy and an analytical mindset, plus a verifiable LinkedIn profile.