Remote AI Training Evaluator for CS Grads

prolificacademicltd; United States; Remote; USD 68,000 - 97,000; Full time

Benefits offered by this job

Remote work

PayPal payments

Skills assessment

Job summary

prolificacademicltd is seeking contributors to apply computer science expertise to paid tasks that help train and assess AI systems. Tasks vary in length, with some requiring an uninterrupted hour; rates may reach $60 per hour.

An initial 10–15 minute skills assessment is required before joining the pool. Applicants should hold a bachelor’s degree in computer science or a closely related field, be able to read research papers, and assess code logic.

Qualifications

• Bachelor’s degree in computer science or a closely related technical field.
• Ability to read research papers, understand complex algorithms, and assess code logic.
• Strong analytical judgment and attention to technical inaccuracies or flawed reasoning.
• A professional profile that can be used to verify education and background during screening.
• A PayPal account for receiving payments.
• Willingness to complete an initial 10–15 minute assessment and, for some tasks, work uninterrupted for an hour.

Responsibilities

• Compare AI responses to technical prompts and rank them for accuracy, logic, and safety.
• Review computer science research and AI-generated summaries or visual abstracts for fidelity to the source.
• Find errors in explanations of technical data, formulas, algorithms, and research results.
• Check AI-generated code and architecture diagrams for logical and structural correctness.
• Provide expert judgments that can guide model training and evaluation.

Skills

Reading research papers

Understanding complex algorithms

Analytical judgment

Attention to technical inaccuracies

Profile verification

Education

Bachelor's degree in computer science or related field

Tools

Code review

Job description

prolificacademicltd is seeking contributors to apply computer science expertise to paid tasks that help train and assess AI systems. Tasks vary in length, with some requiring an uninterrupted hour; rates may reach $60 per hour.

An initial 10–15 minute skills assessment is required before joining the pool. Applicants should hold a bachelor’s degree in computer science or a closely related field, be able to read research papers, and assess code logic.