CS Graduates Wanted: AI Training Evaluator (Remote)

Prolific; United States; Remote; USD 50,000 - 83,000; Full time

Benefits offered by this job

Flexible hours

Work from home

Job summary

Prolific is seeking Computer Science Specialists to join our Expert Network to help train and evaluate AI models. After a brief 10–15 minute test, successful candidates may join Prolific as participants and earn money for paid tasks.

In this role you will perform AI evaluation, ranking, and scientific review of CS research papers. You will also fact-check data, contribute to RLHF, and audit AI-generated code and diagrams, all from a remote setting.

Qualifications

• Technical literacy: ability to interpret research papers, understand algorithms, review code logic.
• Analytical mindset: high cognitive competency with attention to detail.
• Professional verification: a valid LinkedIn profile to verify degree and background during screening.

Responsibilities

• AI Evaluation & Ranking: compare AI responses and rank by accuracy, logic, and safety.
• Scientific Review: assess CS research papers alongside AI-generated summaries for integrity.
• Fact-Checking: identify inaccuracies where AI misinterprets data or findings.
• RLHF: provide human ground truth to align models with professional standards.
• Code & Logic Verification: audit AI-generated code and diagrams for correctness.

Skills

Technical literacy

Analytical mindset

Professional verification

Education

BSc in Computer Science

Job description

Prolific is seeking Computer Science Specialists to join our Expert Network to help train and evaluate AI models. After a brief 10–15 minute test, successful candidates may join Prolific as participants and earn money for paid tasks.

In this role you will perform AI evaluation, ranking, and scientific review of CS research papers. You will also fact-check data, contribute to RLHF, and audit AI-generated code and diagrams, all from a remote setting.