AI Training Evaluator for CS Grads - Remote, Up to $60/hr

prolificacademicltd; United States; Remote; USD 55,000 - 83,000; Part time

Benefits offered by this job

Remote work

Flexible tasks

Pay via PayPal

Job summary

Prolific Academic Ltd. is seeking participants to contribute computer science expertise to training and evaluating AI models through paid, project-based tasks. You will review AI-generated explanations, summaries, code, and diagrams for accuracy and logical soundness.

Tasks vary in length, with some requiring about an hour of uninterrupted work. Remote, flexible participation is supported, and pay can reach up to $60 per hour based on skills and assignment.

Qualifications

• Bachelor's degree in computer science or closely related technical discipline.
• Ability to interpret research papers, understand complex algorithms, and review code logic.
• Strong analytical judgment and attention to technical inaccuracies or flawed reasoning.
• LinkedIn profile to support verification of education and background during screening.
• PayPal account for receiving payments.
• Availability for occasional tasks requiring one hour of uninterrupted work.

Responsibilities

• Compare AI responses to technical questions and rank them for accuracy, reasoning, and safety.
• Review computer science research and AI-produced summaries or visual abstracts for fidelity to the underlying work.
• Check technical claims, formulas, and findings, identifying errors or misinterpretations.
• Assess generated code and system diagrams for logical structure and functional correctness.
• Provide expert feedback that helps improve AI systems' technical reasoning and alignment with professional standards.

Skills

Interpreting research papers

Understanding complex algorithms

Reviewing code logic

Analytical judgment

Attention to inaccuracies

Education

Bachelor's degree in computer science or related discipline

Job description

Prolific Academic Ltd. is seeking participants to contribute computer science expertise to training and evaluating AI models through paid, project-based tasks. You will review AI-generated explanations, summaries, code, and diagrams for accuracy and logical soundness.

Tasks vary in length, with some requiring about an hour of uninterrupted work. Remote, flexible participation is supported, and pay can reach up to $60 per hour based on skills and assignment.