CS Graduate — AI Model Evaluator & Reviewer (Remote)

prolificacademicltd; United States; Remote; USD 55,000 - 83,000; Part time

Benefits offered by this job

Remote, flexible participation

Job summary

prolificacademicltd seeks individuals to contribute computer science expertise to the training and evaluation of AI models through paid, project-based tasks. You will review research papers, explanations, and code for accuracy and logical soundness, with an initial skills assessment and assignments varying in length, some requiring an uninterrupted hour.

Remote, flexible participation is offered. Task rates may reach $60 per hour, with PayPal used for payments.

Qualifications

• Interpret research papers and understand complex algorithms.
• Review code logic for correctness and clarity.
• Demonstrate strong analytical judgment and attention to inaccuracies or flawed reasoning.
• Provide verification via LinkedIn profile during screening.
• Payments are received via PayPal and may require one uninterrupted hour for some tasks.

Responsibilities

• Compare AI responses to technical questions and rank by accuracy, reasoning, and safety.
• Review research and AI-produced summaries for fidelity to underlying work.
• Check technical claims, formulas, and findings for errors or misinterpretations.
• Assess generated code and system diagrams for logical structure and function.
• Provide expert feedback to improve AI systems' technical reasoning and alignment.

Skills

Analytical thinking

Code review

Technical judgment

Education

Bachelor's degree in computer science

Job description

prolificacademicltd seeks individuals to contribute computer science expertise to the training and evaluation of AI models through paid, project-based tasks. You will review research papers, explanations, and code for accuracy and logical soundness, with an initial skills assessment and assignments varying in length, some requiring an uninterrupted hour.

Remote, flexible participation is offered. Task rates may reach $60 per hour, with PayPal used for payments.