AI Evaluation Specialist (CS) — Remote & Flexible Hours

Prolific Academic Ltd; United States; Remote; USD 68,000 - 97,000; Full time

Benefits offered by this job

Flexible hours

Work from home

Competitive pay

Job summary

Prolific is seeking Computer Science Specialists to join its Expert Network to help train and evaluate AI models. If you have a CS research or technical analysis background, you’ll complete a brief 10–15 minute test; successful candidates will be invited to join Prolific as a participant and paid for tasks.

Participants can expect flexible hours and the ability to work from home. Prolific offers competitive pay rates, with opportunities to earn up to $60/hr depending on skills and experience.

Qualifications

• Minimum BSc in Computer Science or closely related field.
• Ability to interpret research papers and understand complex algorithms.
• High attention to detail to identify logical flaws in data and code.
• Provide a valid LinkedIn profile for background verification during screening.
• Have a PayPal account to receive payments from clients.

Responsibilities

• AI Evaluation & Ranking: compare AI-generated responses to prompts and rank by accuracy and safety.
• Scientific Review: assess CS research papers and AI summaries for integrity.
• Fact-Checking: identify inaccuracies in data, formulas or findings.
• RLHF: provide human ground truth to guide models in software engineering and data science.
• Code & Logic Verification: audit AI-generated code snippets and diagrams for correctness.

Skills

Research interpretation

Algorithm understanding

Code review

LinkedIn verification

PayPal setup

Education

BSc in Computer Science

Job description

Prolific is seeking Computer Science Specialists to join its Expert Network to help train and evaluate AI models. If you have a CS research or technical analysis background, you’ll complete a brief 10–15 minute test; successful candidates will be invited to join Prolific as a participant and paid for tasks.

Participants can expect flexible hours and the ability to work from home. Prolific offers competitive pay rates, with opportunities to earn up to $60/hr depending on skills and experience.