AI Model Evaluator & CS Specialist (Remote)

Prolific; West of England; Remote; GBP 37,000 - 62,000; Part time

Benefits offered by this job

PayPal payments

Flexible hours

Job summary

Prolific is seeking Computer Science Specialists to join our Expert Network to help train and evaluate AI models. You will complete a brief screening test, then participate as paid evaluators working from home with competitive hourly pay.

Candidates should have a BSc in Computer Science or related field, strong technical analysis skills, and the ability to interpret research papers and code. Verification will occur via LinkedIn and PayPal for payments.

Qualifications

• Educational background: minimum BSc in Computer Science or related technical field.
• Ability to interpret research papers, understand algorithms, and review code logic.

Responsibilities

• AI Evaluation & Ranking: compare AI responses and rank by accuracy, logic, and safety.
• Scientific Review: assess CS research papers and AI-generated summaries for integrity.
• Fact-Checking: spot inaccuracies where AI misinterprets data, formulas, or findings.
• RLHF: provide human ground truth to align models with software engineering standards.
• Code & Logic Verification: audit AI-generated code and diagrams for correctness.

Skills

CS research background

Technical analysis

Code review

English proficiency

Education

BSc in Computer Science

Job description

Prolific is seeking Computer Science Specialists to join our Expert Network to help train and evaluate AI models. You will complete a brief screening test, then participate as paid evaluators working from home with competitive hourly pay.

Candidates should have a BSc in Computer Science or related field, strong technical analysis skills, and the ability to interpret research papers and code. Verification will occur via LinkedIn and PayPal for payments.