Remote AI Evaluation Specialist - CS Graduates

prolificacademicltd; United States; Remote; USD 50,000 - 83,000; Full time

Benefits offered by this job

Flexible schedule

Remote work

Task-based pay

Job summary

Prolific Academic Ltd is seeking evaluators who will use computer science expertise to assess AI outputs through paid, project-based tasks. You may judge technical answers, review summaries, or evaluate code and diagrams. A brief skills assessment is required to join our participant network.

Work is remote and flexible, with earnings cited up to $60 per hour. Tasks vary by project and expertise, and most assignments require up to an hour of focused effort.

Qualifications

• Bachelor's degree in computer science or a closely related technical discipline.
• Ability to interpret research papers, understand complex algorithms, and assess code logic.
• Strong analytical judgment and attention to technical inaccuracies or flawed reasoning.

Responsibilities

• Compare AI responses to technical questions and rate accuracy, reasoning, and safety.
• Check research papers and AI-generated summaries or visual abstracts for fidelity to the underlying work.
• Find errors in explanations of technical data, formulas, algorithms, and research results.
• Review generated code and system diagrams for sound logic and structure.
• Provide expert feedback that helps align AI outputs with software engineering and data science standards.

Skills

Analytical thinking

Research papers interpretation

Code logic assessment

Education

Bachelor's degree in computer science

Job description

Prolific Academic Ltd is seeking evaluators who will use computer science expertise to assess AI outputs through paid, project-based tasks. You may judge technical answers, review summaries, or evaluate code and diagrams. A brief skills assessment is required to join our participant network.

Work is remote and flexible, with earnings cited up to $60 per hour. Tasks vary by project and expertise, and most assignments require up to an hour of focused effort.