AI Systems Evaluator (Remote • Flexible, Up to $60/hr)

prolificacademicltd; United States; Remote; USD 68,000 - 97,000; Full time

Benefits offered by this job

Flexible, remote work participation

PayPal payments

Up to $60/hour potential

Job summary

prolificacademicltd is seeking computer science–savvy evaluators to help assess and improve AI systems. After a brief skills assessment, you may be invited to complete paid tasks reviewing technical answers, summaries, and code. Tasks vary in length; some require up to one uninterrupted hour.

Flexible, remote participation is offered; task rates may reach $60 per hour based on skills and experience. Entry includes a short skills assessment.

Qualifications

• Bachelor's degree in computer science or a closely related technical field.
• Ability to interpret research papers and understand complex algorithms.
• Strong analytical judgment and attention to technical inaccuracies.
• LinkedIn profile for verification of education and professional background.
• PayPal account to receive task payments.
• Ability to focus on tasks that may require up to one uninterrupted hour.

Responsibilities

• Compare AI responses to technical questions for accuracy, reasoning, and safety.
• Review research papers and AI-generated summaries or graphical abstracts for fidelity to the source.
• Spot errors in technical explanations, formulas, algorithms, and research findings.
• Check generated code and architecture diagrams for logical and structural correctness.
• Apply evaluation criteria to provide feedback that helps align model outputs with professional standards.

Skills

Research paper interpretation

Algorithm understanding

Code review

Analytical judgment

Education

Bachelor's degree in computer science or related field

Job description

prolificacademicltd is seeking computer science–savvy evaluators to help assess and improve AI systems. After a brief skills assessment, you may be invited to complete paid tasks reviewing technical answers, summaries, and code. Tasks vary in length; some require up to one uninterrupted hour.

Flexible, remote participation is offered; task rates may reach $60 per hour based on skills and experience. Entry includes a short skills assessment.