AI Training & Evaluation for CS Graduates (Remote)

Prolific Academic Ltd; United States; Remote; USD 68,000 - 97,000; Full time

Job summary

Prolific is seeking Computer Science Specialists to join our Expert Network to help train and evaluate AI models. You will complete a short 10- to 15-minute test; if successful, you’ll be invited to participate and paid to assist in evaluating scientific data.

Researchers pay up to $60/hr, and tasks often require about one uninterrupted hour. This role emphasizes rigorous analysis, review of research papers, and verification of technical details, with remote-friendly, flexible hours.

Qualifications

• BSc (Bachelor of Science) in Computer Science or closely related technical field.
• Ability to interpret research papers and review code logic.
• Valid LinkedIn profile to verify degree and background during screening.
• PayPal account to receive payment from clients.

Responsibilities

• AI Evaluation & Ranking: compare multiple AI-generated responses to prompts and rank them by accuracy, logic, and safety.
• Scientific Review: review CS research papers alongside AI-generated summaries for integrity.
• Fact-Checking: identify inaccuracies where AI misinterprets data, formulas, or findings.
• RLHF: provide human ground truth to align models with professional standards in software engineering and data science.
• Code & Logic Verification: audit AI-generated code snippets and diagrams for correctness.

Skills

Analytical mindset

Technical literacy

Professional verification via LinkedIn

PayPal account

Education

BSc in Computer Science

Job description

Prolific is seeking Computer Science Specialists to join our Expert Network to help train and evaluate AI models. You will complete a short 10- to 15-minute test; if successful, you’ll be invited to participate and paid to assist in evaluating scientific data.

Researchers pay up to $60/hr, and tasks often require about one uninterrupted hour. This role emphasizes rigorous analysis, review of research papers, and verification of technical details, with remote-friendly, flexible hours.