AI Training Evaluator - Software & Research QA (Remote)

prolificacademicltd; United States; Remote; USD 50,000 - 83,000; Full time

Benefits offered by this job

Flexible, remote task work

Job summary

Prolific Academic Ltd is seeking specialists to help assess and improve AI systems from a computer science perspective. You will evaluate AI responses, review research papers, and examine code and diagrams for accuracy and structural integrity.

This remote, task-based role involves paid assignments after a brief assessment. Applicants should hold a bachelor’s degree in computer science or related field and demonstrate strong analytical skills to detect unsupported claims and errors across

Qualifications

• Bachelor’s degree in computer science or closely related technical field.
• Ability to read research papers, understand algorithms, and review code logic.
• Strong analytical ability and care in detecting unsupported claims and reasoning flaws.

Responsibilities

• Evaluate and rank AI responses to technical questions for accuracy, sound logic, and safety.
• Review computer science papers alongside generated summaries and visual abstracts for faithful representation.
• Identify technical errors, including misread formulas, data, or research findings.
• Inspect generated code and system architecture diagrams for functional and structural correctness.
• Supply expert assessments and feedback to support AI training in software engineering and data science.

Skills

Reading papers

Algorithms

Code review

Analytical thinking

Education

Bachelor’s degree in computer science or related technical field

Job description

Prolific Academic Ltd is seeking specialists to help assess and improve AI systems from a computer science perspective. You will evaluate AI responses, review research papers, and examine code and diagrams for accuracy and structural integrity.

This remote, task-based role involves paid assignments after a brief assessment. Applicants should hold a bachelor’s degree in computer science or related field and demonstrate strong analytical skills to detect unsupported claims and errors across