Remote AI Evaluation for CS Grads — Up to $60/hr

prolificacademicltd; United States; Remote; USD 55,000 - 83,000; Part time

Benefits offered by this job

Flexible work

Remote work

Up to $60/hour

Job summary

Prolific Academic Ltd is seeking individuals to evaluate AI systems on a project basis. You will judge technical answers, review research summaries, and assess code and diagrams to ensure fidelity and sound reasoning. A short skills assessment is part of the screening process.

Requirements include a Bachelor’s degree in computer science or related field, ability to interpret papers, and strong analytical judgment. Remote, flexible work with payments via PayPal and compensation up to $60 per hour.

Qualifications

• Bachelor's degree in computer science or related technical discipline.
• Ability to interpret research papers, understand algorithms, and assess code logic.
• Strong analytical judgment and attention to technical inaccuracies or flawed reasoning.
• A LinkedIn profile for verification of education and professional background.
• A PayPal account to receive payments.
• Availability for tasks requiring up to an hour of uninterrupted work; some tasks are shorter.

Responsibilities

• Compare AI responses to technical questions and rate their accuracy, reasoning, and safety.
• Check research papers and AI-generated summaries or visual abstracts for fidelity to the underlying work.
• Find errors in explanations of technical data, formulas, algorithms, and research results.
• Review generated code and system diagrams for sound logic and structure.
• Provide expert feedback that helps align AI outputs with software engineering and data science standards.

Skills

Analytical judgement

Interpret research papers

Understand complex algorithms

Code logic assessment

Attention to technical inaccuracies

Education

Bachelor's degree in computer science

Job description

Prolific Academic Ltd is seeking individuals to evaluate AI systems on a project basis. You will judge technical answers, review research summaries, and assess code and diagrams to ensure fidelity and sound reasoning. A short skills assessment is part of the screening process.

Requirements include a Bachelor’s degree in computer science or related field, ability to interpret papers, and strong analytical judgment. Remote, flexible work with payments via PayPal and compensation up to $60 per hour.