Remote AI Evaluation & Research Specialist (CS)

Prolific; Caernarfon; Remote; GBP 51,000 - 72,000; Full time

Benefits offered by this job

Competitive pay rates

Flexible hours

Work from home

Job summary

Prolific is seeking Computer Science Specialists to join its Expert Network to help train and evaluate AI models. A quick 10- to 15-minute test will assess your skills, and successful candidates will be invited to join as paid participants.

Pay can be up to $60/hr depending on skills and experience, with tasks typically requiring about one hour of uninterrupted work, though many are shorter. Flexible hours and remote work are possible.

Qualifications

• BSc in Computer Science or closely related technical field.
• Ability to interpret research papers, understand complex algorithms, and review code logic.
• Professional verification via a valid LinkedIn profile during screening.
• A PayPal account to receive payment from clients.

Responsibilities

• AI Evaluation & Ranking: compare multiple AI-generated responses and rank them by accuracy, logic, and safety.
• Scientific Review: assess CS research papers and AI-generated summaries for integrity.
• Fact-Checking: identify inaccuracies where AI misinterprets data, formulas, or findings.
• RLHF: provide human 'ground truth' to align models with professional software engineering and data science standards.
• Code & Logic Verification: audit AI-generated code snippets and diagrams for correctness.

Skills

Technical literacy

Analytical mindset

Code & data interpretation

Education

BSc in Computer Science

Tools

PayPal

Job description

Prolific is seeking Computer Science Specialists to join its Expert Network to help train and evaluate AI models. A quick 10- to 15-minute test will assess your skills, and successful candidates will be invited to join as paid participants.

Pay can be up to $60/hr depending on skills and experience, with tasks typically requiring about one hour of uninterrupted work, though many are shorter. Flexible hours and remote work are possible.