CS Specialist for AI Evaluation & Training (Remote)

Prolific; United States; Remote; USD 68,000 - 97,000; Part time

Benefits offered by this job

Flexible hours

Work from home

Competitive pay rates

Job summary

Prolific seeks Computer Science Specialists to join the Expert Network for training and evaluating AI models. You will complete a brief test, then participate as paid contributors, with flexible hours and the option to work from home.

Responsibilities include evaluating AI outputs, reviewing scientific content, and providing ground-truth feedback to improve model performance. A BSc in CS and a valid LinkedIn profile are required.

Qualifications

• BSc in Computer Science or closely related technical field.
• Ability to interpret research papers, understand complex algorithms, and review code logic.
• LinkedIn profile to verify degree and background during screening.
• PayPal account to receive payment from clients.

Responsibilities

• AI Evaluation & Ranking: compare AI-generated responses and rank by accuracy, logic, and safety.
• Scientific Review: review CS research papers with AI-generated summaries for integrity.
• Fact-Checking: identify inaccuracies where AI misinterprets data or findings.
• RLHF: provide human ground truth to align models with software engineering and data science standards.
• Code & Logic Verification: audit AI-generated code and diagrams for correctness.

Skills

Analytical mindset

Technical literacy

Research paper interpretation

Code & logic review

LinkedIn verification

PayPal account readiness

Education

BSc in Computer Science

Job description

Prolific seeks Computer Science Specialists to join the Expert Network for training and evaluating AI models. You will complete a brief test, then participate as paid contributors, with flexible hours and the option to work from home.

Responsibilities include evaluating AI outputs, reviewing scientific content, and providing ground-truth feedback to improve model performance. A BSc in CS and a valid LinkedIn profile are required.