AI Evaluation Scientist (CS Specialist) - Remote

Prolific; United States; Remote; USD 50,000 - 83,000; Full time

Job summary

Prolific is seeking Computer Science Specialists to join our Expert Network to help train and evaluate cutting-edge AI models. You’ll undergo a brief test and, if successful, join Prolific to earn pay for paid tasks.

Roles involve evaluating AI outputs, reviewing research papers, and ensuring technical accuracy. A background in CS and a PayPal account are required; remote work is supported from anywhere with flexible hours.

Qualifications

• Educational background: BSc (Bachelor of Science) in Computer Science or closely related technical field.
• Analytical mindset with ability to review code logic and interpret research papers.
• Strong technical literacy to understand algorithms and data.
• Professional verification via LinkedIn profile.
• PayPal account to receive payment from clients.

Responsibilities

• AI Evaluation & Ranking: compare multiple AI-generated responses to prompts and rank by accuracy, logic and safety.
• Scientific Review: assess CS research papers with AI-generated summaries for integrity.
• Fact-Checking: identify inaccuracies where AI misinterprets data or findings.
• RLHF: provide human ground-truth to align models with software engineering standards.
• Code & Logic Verification: audit AI-generated code snippets and diagrams for correctness.

Education

BSc in Computer Science

Job description

Prolific is seeking Computer Science Specialists to join our Expert Network to help train and evaluate cutting-edge AI models. You’ll undergo a brief test and, if successful, join Prolific to earn pay for paid tasks.

Roles involve evaluating AI outputs, reviewing research papers, and ensuring technical accuracy. A background in CS and a PayPal account are required; remote work is supported from anywhere with flexible hours.