AI Training & Evaluation Specialist (CS) — Remote

Prolific; United States; Remote; USD 50,000 - 83,000; Full time

Benefits offered by this job

Flexible hours

Work from home

Job summary

Prolific is seeking Computer Science Specialists to join our Expert Network to help train and evaluate AI models. You’ll complete a short test; if successful, you’ll be invited to participate and get paid for tasks that support high-quality data for AI research.

Responsibilities include evaluating AI outputs, reviewing CS research papers, fact-checking data, and providing ground-truth feedback to align models with software engineering standards. Remote work is possible.

Qualifications

• BSc in Computer Science or closely related technical field.
• Ability to interpret research papers and review code logic.
• High cognitive ability with attention to technical accuracy.
• Valid LinkedIn profile to verify degree during screening.
• PayPal account to receive payment.

Responsibilities

• AI evaluation and ranking of multiple AI-generated responses.
• Scientific review of CS research papers and AI summaries.
• Fact-checking to identify inaccuracies in data, formulas, or findings.
• RLHF: provide human ground truth to align models with standards.
• Code and logic verification of AI-generated snippets and diagrams.

Skills

BSc in Computer Science

Technical literacy

Analytical mindset

Professional verification (LinkedIn)

PayPal account

Education

BSc (Bachelor of Science) in Computer Science

Job description

Prolific is seeking Computer Science Specialists to join our Expert Network to help train and evaluate AI models. You’ll complete a short test; if successful, you’ll be invited to participate and get paid for tasks that support high-quality data for AI research.

Responsibilities include evaluating AI outputs, reviewing CS research papers, fact-checking data, and providing ground-truth feedback to align models with software engineering standards. Remote work is possible.