CS Specialist: AI Evaluation & Research (Remote)

Prolific; United States; Remote; USD 50,000 - 83,000; Full time

Job summary

Prolific is seeking Computer Science Specialists to join our Expert Network. You will help train and evaluate AI models by ranking responses, reviewing research papers, and verifying code and logic. A background in CS and the ability to interpret complex material are essential.

Selected participants will complete a brief test, then perform paid tasks on a flexible, remote schedule, with compensation up to $60 per hour depending on skills and experience.

Qualifications

• BSc (Bachelor of Science) in Computer Science or a closely related technical field.
• Ability to interpret research papers, understand complex algorithms, and review code logic.
• Professional verification via a valid LinkedIn profile during screening.

Responsibilities

• AI Evaluation & Ranking: compare AI responses and rank them by accuracy, logic, and safety.
• Scientific Review: review CS research papers with AI summaries to ensure integrity.
• Fact-Checking: identify inaccuracies where AI misinterprets data, formulas, or findings.
• RLHF: provide human ground truth to help models align with software engineering and data science standards.
• Code & Logic Verification: audit AI-generated code snippets and diagrams for correctness.

Skills

Analytical Mindset

Technical Literacy

Professional Verification

Education

BSc in Computer Science

Job description

Prolific is seeking Computer Science Specialists to join our Expert Network. You will help train and evaluate AI models by ranking responses, reviewing research papers, and verifying code and logic. A background in CS and the ability to interpret complex material are essential.

Selected participants will complete a brief test, then perform paid tasks on a flexible, remote schedule, with compensation up to $60 per hour depending on skills and experience.