AI Training Evaluator — CS Graduates (Remote)

Prolific; United States; Remote; USD 50,000 - 83,000; Full time

Job summary

Prolific is seeking Computer Science Specialists to join our Expert Network to train and evaluate AI models. If you have a CS research or technical analysis background, you’ll complete a 10- to 15-minute test; if successful, you’ll be invited to join Prolific as a participant, paid to help AI understand and summarize complex scientific data.

In this role you’ll evaluate AI outputs, review CS papers, and perform fact-checks to ensure accuracy and reliability.

Qualifications

• Educational background: minimum a BSc in Computer Science or closely related field.
• Technical literacy: interpret research papers, analyze algorithms, review code logic.
• Analytical mindset: high cognitive ability with eye for flaws.
• Professional verification: valid LinkedIn profile for screening.
• PayPal account required to receive payments.

Responsibilities

• AI evaluation & ranking: compare AI responses and rank by accuracy and safety.
• Scientific review: assess CS research papers and AI-generated summaries.
• Fact-checking: identify inaccuracies in data, formulas, or findings.
• RLHF: provide human ground truth to align models with standards.
• Code & logic verification: audit generated code and diagrams.

Skills

Technical literacy

Analytical mindset

LinkedIn verification

PayPal account

Education

BSc in Computer Science

Job description

Prolific is seeking Computer Science Specialists to join our Expert Network to train and evaluate AI models. If you have a CS research or technical analysis background, you’ll complete a 10- to 15-minute test; if successful, you’ll be invited to join Prolific as a participant, paid to help AI understand and summarize complex scientific data.

In this role you’ll evaluate AI outputs, review CS papers, and perform fact-checks to ensure accuracy and reliability.