CS Expert for AI Evaluation - Remote, Flexible Hours

Prolific; United States; Remote; USD 55,000 - 83,000; Full time

Job summary

Prolific is seeking Computer Science Specialists to join its Expert Network to help train and evaluate AI models. You’ll complete a 10–15 minute test to assess your CS skills, and if successful, you’ll be invited to participate and be paid for tasks requiring focused, uninterrupted work.

Projects pay up to $60/hr, with flexible hours and the option to work from home once onboarded. Join a global pool of researchers and companies on Prolific’s platform.

Qualifications

• Educational background: at minimum, a BSc (Bachelor of Science) in Computer Science or a closely related technical field.
• Technical literacy: ability to interpret research papers, understand complex algorithms, and review code logic.
• Analytical mindset: high level of cognitive competency with a sharp eye for technical hallucinations or logical flaws.
• Professional verification: a valid LinkedIn profile to verify your degree and background during the screening process.
• A PayPal account to receive payment from our clients

Responsibilities

• AI Evaluation & Ranking: comparing multiple AI-generated responses to technical prompts and ranking them based on accuracy, logic, and safety.
• Scientific Review: reviewing CS research papers alongside AI-generated summaries and graphical abstracts to ensure scientific integrity.
• Fact-Checking: identifying inaccuracies where the AI has misinterpreted technical data, formulas, or research findings.
• RLHF (Reinforcement Learning from Human Feedback): providing the human “ground truth” to help models align with professional standards in software engineering and data science.
• Code & Logic Verification: auditing AI-generated code snippets or architectural diagrams for structural and functional correctness

Skills

Technical literacy

Analytical mindset

LinkedIn verification

PayPal account

Education

BSc in Computer Science

Job description

Prolific is seeking Computer Science Specialists to join its Expert Network to help train and evaluate AI models. You’ll complete a 10–15 minute test to assess your CS skills, and if successful, you’ll be invited to participate and be paid for tasks requiring focused, uninterrupted work.

Projects pay up to $60/hr, with flexible hours and the option to work from home once onboarded. Join a global pool of researchers and companies on Prolific’s platform.