CS Graduate - AI Evaluation & Training Expert

Prolific Academic Ltd; United States; Remote; USD 69,000 - 103,000; Full time

Job summary

Prolific is seeking Computer Science Specialists to join our Expert Network to help train and evaluate AI models. You will test and review CS research, assess AI prompts, and provide ground truth to improve model alignment.

Selected researchers will complete a 10- to 15-minute test; if successful, you’ll be invited to join Prolific as a participant, with paid tasks, flexible hours, and the ability to work from home in the United States.

Qualifications

• BSc in CS or closely related field is required.
• Ability to interpret research papers and detect errors.
• Experience reviewing code logic and technical analyses.

Responsibilities

• AI Evaluation & Ranking: compare AI responses and rank by accuracy and safety.
• Scientific Review: assess CS research papers and AI-generated summaries.
• Fact-Checking: identify inaccuracies in data, formulas or findings.
• RLHF: provide human ground truth to align models with standards.

Skills

BSc CS

Technical literacy

Analytical mindset

LinkedIn verification

PayPal account

Education

BSc (Bachelor of Science) in Computer Science

Tools

Code review

Verification frameworks

Research papers interpretation

Job description

Prolific is seeking Computer Science Specialists to join our Expert Network to help train and evaluate AI models. You will test and review CS research, assess AI prompts, and provide ground truth to improve model alignment.

Selected researchers will complete a 10- to 15-minute test; if successful, you’ll be invited to join Prolific as a participant, with paid tasks, flexible hours, and the ability to work from home in the United States.