CS AI Evaluation Specialist — Remote, Flexible Hours

Prolific; United States; Remote; USD 50,000 - 83,000; Part time

Job summary

Prolific is seeking Computer Science Specialists to join its Expert Network to help train and evaluate cutting-edge AI models. If you have a background in CS research or technical analysis, we’ll send you a quick 10- to 15-minute test to assess your skills.

If successful, you’ll be invited to join Prolific as a participant, where you’ll get paid for your work. Researchers looking for your skills tend to pay up to $60/hr, depending on skills and experience level.

Qualifications

• BSc in Computer Science or closely related technical field.
• Ability to interpret research papers and review code logic.
• LinkedIn profile for professional verification.
• PayPal account to receive payment from clients.

Responsibilities

• AI Evaluation & Ranking: compare AI responses and rank by accuracy and safety.
• Scientific Review: assess CS research papers and AI summaries for integrity.
• Fact-Checking: identify inaccuracies in data, formulas, or findings.
• RLHF: provide human ground truth to align models with engineering standards.
• Code & Logic Verification: audit AI-generated code and diagrams.

Skills

Technical literacy

Analytical mindset

Verification of background (LinkedIn)

Education

BSc in Computer Science

Job description

Prolific is seeking Computer Science Specialists to join its Expert Network to help train and evaluate cutting-edge AI models. If you have a background in CS research or technical analysis, we’ll send you a quick 10- to 15-minute test to assess your skills.

If successful, you’ll be invited to join Prolific as a participant, where you’ll get paid for your work. Researchers looking for your skills tend to pay up to $60/hr, depending on skills and experience level.