Flexible Remote AI Evaluation for CS Graduates

prolificacademicltd; United States; Remote; USD 68,000 - 97,000; Full time

Benefits offered by this job

Flexible remote participation

Expert participant network

Risk-free entry with screening

Job summary

Prolific Academic Ltd is offering flexible, remote, task-based work evaluating and improving AI systems. You will assess technical questions, review research material, and verify code logic on an hourly basis, with some tasks needing a solid uninterrupted hour.

Ideal candidates have a CS degree, strong analytical skills, and can interpret research papers and complex algorithms. A PayPal account is required to receive payments, and screening includes a short skills assessment before joining the

Qualifications

• Bachelor’s degree in computer science or a closely related technical field.
• Ability to interpret research papers, understand complex algorithms, and assess code logic.
• Strong analytical judgment and attention to technical errors or unsupported claims.
• A professional profile that can be used to verify education and background during screening.
• A PayPal account to receive payments.
• Ability to complete occasional tasks requiring one uninterrupted hour.

Responsibilities

• Compare AI responses to technical questions and rate their accuracy, reasoning, and safety.
• Review computer science research alongside AI-generated summaries and visual abstracts.
• Check technical claims, formulas, and findings against source material.
• Assess generated code and architectural diagrams for logical and structural correctness.
• Provide expert feedback that helps align AI outputs with professional software engineering and data science standards.

Skills

Analytical thinking

Interpret research papers

Assess code logic

Review CS research

Education

Bachelor’s degree in computer science or related field

Job description

Prolific Academic Ltd is offering flexible, remote, task-based work evaluating and improving AI systems. You will assess technical questions, review research material, and verify code logic on an hourly basis, with some tasks needing a solid uninterrupted hour.

Ideal candidates have a CS degree, strong analytical skills, and can interpret research papers and complex algorithms. A PayPal account is required to receive payments, and screening includes a short skills assessment before joining the