Remote AI Training Evaluator for CS Graduates - Paid Tasks

prolificacademicltd; United States; Remote; USD 68,000 - 97,000; Part time

Benefits offered by this job

Flexible remote participation

Pay per task up to $60/hour

Job summary

Prolific Academic Ltd. is offering paid, task-based opportunities for individuals with a computer science background to assist in training and evaluating AI systems.

After a brief skills assessment, successful applicants may review technical content and help ensure AI responses are accurate, logical, and safe. Tasks vary in duration, with some requiring up to an hour of uninterrupted work; many are shorter.

Qualifications

• Bachelor's degree in computer science or related field.
• Ability to interpret research papers and analyze complex algorithms.
• Strong analytical judgment and attention to technical errors.
• Professional profile for screening.

Responsibilities

• Compare AI-generated answers to technical questions and rank them for accuracy, reasoning, and safety.
• Review computer science papers and AI summaries for fidelity to the research.
• Check claims, formulas, and findings against source material.
• Assess generated code and architecture diagrams for correctness.
• Provide expert judgments aligning outputs with software engineering and data science standards.

Skills

Interpret research papers

Understand complex algorithms

Review code logic

Analytical judgment

Education

Bachelor's degree in Computer Science

Job description

Prolific Academic Ltd. is offering paid, task-based opportunities for individuals with a computer science background to assist in training and evaluating AI systems.

After a brief skills assessment, successful applicants may review technical content and help ensure AI responses are accurate, logical, and safe. Tasks vary in duration, with some requiring up to an hour of uninterrupted work; many are shorter.