AI Evaluation Specialist (CS) - Remote, Up to $60/hr

Prolific; United States; Remote; USD 68,000 - 97,000; Full time

Benefits offered by this job

Competitive pay rates

Flexible hours

Work from home

Job summary

Prolific is building the world’s largest pool of quality human data for AI development. We’re seeking Computer Science Specialists to join our Expert Network, perform quick skill tests, and, if selected, contribute to training and evaluating AI models from home.

You will evaluate AI outputs, review scientific papers, and verify code logic while enjoying flexible hours and competitive pay. This role offers remote work with a global platform and streamlined onboarding.

Qualifications

• BSc in Computer Science or closely related technical field.
• Ability to interpret research papers and review code logic.
• Analytical mindset with focus on technical accuracy and flaw detection.
• Professional verification via a LinkedIn profile.
• PayPal account to receive payments.

Responsibilities

• AI Evaluation & Ranking: compare AI responses and rank by accuracy and safety.
• Scientific Review: assess CS research papers and AI-generated summaries.
• Fact-Checking: identify inaccuracies in data, formulas, or findings.
• RLHF: provide human ground truth to align models with standards.
• Code & Logic Verification: audit generated code and diagrams for correctness.

Skills

Research interpretation

Code review

Analytical mindset

LinkedIn verification

PayPal payments

Education

BSc in Computer Science

Job description

Prolific is building the world’s largest pool of quality human data for AI development. We’re seeking Computer Science Specialists to join our Expert Network, perform quick skill tests, and, if selected, contribute to training and evaluating AI models from home.

You will evaluate AI outputs, review scientific papers, and verify code logic while enjoying flexible hours and competitive pay. This role offers remote work with a global platform and streamlined onboarding.