AI Evaluation Specialist — Remote, Project-Based Pay

prolificacademicltd; United States; Remote; USD 28,000 - 83,000; Part time

Benefits offered by this job

Remote work

Flexible schedule

Screening assessment

Job summary

Prolific Academic Ltd is seeking contributors to evaluate AI systems through paid, project-based tasks. You will judge technical answers, check research summaries, and review code and diagrams for accuracy.

Applicants should hold a bachelor's degree in computer science, be able to interpret research papers and assess complex algorithms, and provide clear, expert feedback. Remote, flexible work with earnings up to $60 per hour; a short screening assessment (~10–15 minutes) is required.

Qualifications

• A bachelor's degree in computer science or a closely related technical discipline.
• Ability to interpret research papers, understand complex algorithms, and assess code logic.
• Strong analytical judgment and attention to technical inaccuracies or flawed reasoning.
• A LinkedIn profile for verification of education and professional background.
• A PayPal account to receive payments.
• Availability for tasks requiring up to an hour of uninterrupted work.

Responsibilities

• Compare AI responses to technical questions and rate their accuracy, reasoning, and safety.
• Check research papers and AI-generated summaries or visual abstracts for fidelity to the underlying work.
• Find errors in explanations of technical data, formulas, algorithms, and research results.
• Review generated code and system diagrams for sound logic and structure.
• Provide expert feedback that helps align AI outputs with software engineering and data science standards.

Skills

Analytical thinking

Attention to detail

Research interpretation

Education

Bachelor's degree in Computer Science

Tools

Git

GitHub

Jupyter

Job description

Prolific Academic Ltd is seeking contributors to evaluate AI systems through paid, project-based tasks. You will judge technical answers, check research summaries, and review code and diagrams for accuracy.

Applicants should hold a bachelor's degree in computer science, be able to interpret research papers and assess complex algorithms, and provide clear, expert feedback. Remote, flexible work with earnings up to $60 per hour; a short screening assessment (~10–15 minutes) is required.