AI Evaluation & CS Research Specialist

Prolific; United States; Remote; USD 55,000 - 83,000; Full time

Benefits offered by this job

PayPal payments

Job summary

Prolific is seeking Computer Science Specialists to join its Expert Network for training and evaluating AI models. You’ll complete a brief test, then may be invited to join and be paid as a participant to help the AI understand and summarize scientific data.

Researchers pay up to $60/hr, depending on skills and experience. Tasks often require one hour of uninterrupted work, though many are shorter. Screening includes a professional verification via LinkedIn.

Qualifications

• Minimum a BSc in Computer Science or closely related field.
• Ability to interpret research papers, algorithms, and code logic.
• High cognitive precision with focus on technical accuracy.

Responsibilities

• AI Evaluation & Ranking: compare AI responses to prompts and rank by accuracy.
• Scientific Review: assess CS papers and AI summaries for integrity.
• Fact-Checking: identify inaccuracies in data, formulas or findings.
• RLHF: provide ground truth to align models with professional standards.
• Code & Logic Verification: audit AI-generated code and diagrams for correctness.

Skills

Analytical mindset

Technical literacy

Professional verification

PayPal account

Education

BSc (Bachelor of Science) in Computer Science

Tools

PayPal

Job description

Prolific is seeking Computer Science Specialists to join its Expert Network for training and evaluating AI models. You’ll complete a brief test, then may be invited to join and be paid as a participant to help the AI understand and summarize scientific data.

Researchers pay up to $60/hr, depending on skills and experience. Tasks often require one hour of uninterrupted work, though many are shorter. Screening includes a professional verification via LinkedIn.