AI Research Evaluation Specialist — CS Expert (Remote)

Prolific; North East; Remote; GBP 37,000 - 62,000; Full time

Benefits offered by this job

Flexible hours

Work from home

Job summary

Prolific, the global participant marketplace, is seeking Computer Science Specialists to join its Expert Network to train and evaluate AI models. If you have CS research or technical analysis experience, you’ll take a short 10–15 minute test; successful candidates are invited to join and paid to help AI understand complex data.

This remote role offers flexible hours and the chance to work from home, with competitive pay rates.

Qualifications

• BSc in Computer Science or closely related field.
• Ability to interpret research papers and review code logic.
• Attention to detect hallucinations and logical flaws.
• Professional verification via LinkedIn profile.
• PayPal account to receive payments.

Responsibilities

• AI Evaluation & Ranking: comparing AI-generated responses to prompts and ranking them by accuracy.
• Scientific Review: reviewing CS papers and AI-generated summaries for integrity.
• Fact-Checking: identifying inaccuracies in data, formulas, or findings.
• RLHF: providing human ground truth for model alignment in software engineering and data science.
• Code & Logic Verification: auditing AI-generated code and diagrams for correctness.

Skills

CS background

Analytical thinking

Code review

LinkedIn verification

PayPal account

Education

BSc in Computer Science

Job description

Prolific, the global participant marketplace, is seeking Computer Science Specialists to join its Expert Network to train and evaluate AI models. If you have CS research or technical analysis experience, you’ll take a short 10–15 minute test; successful candidates are invited to join and paid to help AI understand complex data.

This remote role offers flexible hours and the chance to work from home, with competitive pay rates.