CS Specialists: AI Evaluation & Research (Remote)

Prolific; United States; Remote; USD 50,000 - 83,000; Full time

Benefits offered by this job

Flexible hours

Work from home

Competitive pay

Job summary

Prolific is seeking Computer Science Specialists to join its Expert Network to train and evaluate AI models. You will complete a short test, then participate as a paid contributor, with tasks requiring one uninterrupted hour and potential payments up to $60/hour.

Ideal candidates hold a BSc in Computer Science and can interpret research papers, review algorithms, and verify code logic. LinkedIn verification and a PayPal account are part of the process.

Qualifications

• BSc in Computer Science or closely related technical field.
• Ability to interpret research papers, understand complex algorithms, and review code logic.
• High level of cognitive competency with attention to technical accuracy and avoidance of hallucinations.
• Professional verification via a valid LinkedIn profile during screening.
• Paypal account required to receive payments.

Responsibilities

• AI Evaluation & Ranking: compare AI-generated responses to prompts and rank by accuracy, logic, and safety.
• Scientific Review: review CS research papers and AI-generated summaries for integrity.
• Fact-Checking: identify inaccuracies in AI interpretations of data, formulas, or findings.
• RLHF: provide human ground truth to align models with standards in software engineering and data science.
• Code & Logic Verification: audit AI-generated code and diagrams for correctness.

Skills

Technical literacy

Analytical mindset

Code review

LinkedIn profile

PayPal account

Education

BSc in Computer Science

Job description

Prolific is seeking Computer Science Specialists to join its Expert Network to train and evaluate AI models. You will complete a short test, then participate as a paid contributor, with tasks requiring one uninterrupted hour and potential payments up to $60/hour.

Ideal candidates hold a BSc in Computer Science and can interpret research papers, review algorithms, and verify code logic. LinkedIn verification and a PayPal account are part of the process.