Remote AI Training & Evaluation Specialist

Prolific; United States; Remote; USD 50,000 - 83,000; Full time

Benefits offered by this job

Flexible hours

Work from home

Job summary

Prolific is seeking Computer Science Specialists to join its Expert Network to help train and evaluate AI models. You’ll take a brief skills test and, if successful, become a paid participant working from home to support high‑quality data collection.

You will rank AI outputs, review CS research papers and AI summaries, and perform fact checking to ensure accuracy, logic, and alignment with professional standards.

Qualifications

• Must hold a BSc in Computer Science or related field.
• Strong ability to interpret research papers and understand algorithms.
• Ability to identify logical flaws and structural issues in code.

Responsibilities

• AI Evaluation & Ranking: compare AI responses to prompts and rate accuracy and safety.
• Scientific Review: assess CS research papers and AI summaries for integrity.
• Fact-Checking: spot inaccuracies in data, formulas, or findings.
• RLHF: provide human ground truth to align models with software engineering standards.
• Code & Logic Verification: audit AI-generated code and diagrams for correctness.

Skills

Technical literacy

Analytical mindset

Code review

Education

BSc in Computer Science

Job description

Prolific is seeking Computer Science Specialists to join its Expert Network to help train and evaluate AI models. You’ll take a brief skills test and, if successful, become a paid participant working from home to support high‑quality data collection.

You will rank AI outputs, review CS research papers and AI summaries, and perform fact checking to ensure accuracy, logic, and alignment with professional standards.