AI Evaluation Engineer - Remote, High-Impact CS Work

Prolific; City of Edinburgh; Remote; GBP 51,000 - 73,000; Full time

Benefits offered by this job

Flexible hours

Work from home

Job summary

Prolific is seeking Computer Science Specialists to join our Expert Network for AI training and evaluation. After a quick 10–15 minute test, successful candidates may be invited to join Prolific as participants, with paid tasks that may require an hour of uninterrupted work and often shorter.

Researchers pay for your skills, with up to $60/hr depending on experience and task complexity. You'll be evaluated on technical expertise, and tasks can be completed remotely with flexible hours.

Qualifications

• BSc in Computer Science or closely related technical field.
• Ability to interpret research papers and understand complex algorithms.
• Review code logic and identify potential issues.

Responsibilities

• AI Evaluation & Ranking: compare AI-generated responses and rank based on accuracy and safety.
• Scientific Review: assess CS papers and AI-generated summaries for integrity.
• Fact-Checking: identify inaccuracies in data, formulas, or findings.
• RLHF: provide human ground truth to align models with professional standards in software engineering and data science.
• Code & Logic Verification: audit code snippets and diagrams for correctness.

Skills

Technical literacy

Analytical mindset

LinkedIn verification

PayPal account

Education

BSc in Computer Science

Job description

Prolific is seeking Computer Science Specialists to join our Expert Network for AI training and evaluation. After a quick 10–15 minute test, successful candidates may be invited to join Prolific as participants, with paid tasks that may require an hour of uninterrupted work and often shorter.

Researchers pay for your skills, with up to $60/hr depending on experience and task complexity. You'll be evaluated on technical expertise, and tasks can be completed remotely with flexible hours.