Remote CS Specialist - AI Model Training & Evaluation

Prolific Academic Ltd; United States; Remote; USD 68,000 - 97,000; Full time

Benefits offered by this job

Competitive pay rates

Flexible hours

Work from home

Job summary

Prolific is seeking Computer Science Specialists to join its Expert Network to train and evaluate AI models. You’ll complete a short skills test; if successful, you’ll be invited to participate and paid to help AI understand scientific data.

Roles involve evaluating AI outputs, ranking responses, and verifying code and research papers. Pay rates can reach up to $60/hr, with the possibility to work from home and flexible hours.

Qualifications

• BSc (Bachelor of Science) in Computer Science or closely related technical field.
• Ability to interpret research papers, understand complex algorithms, and review code logic.
• Analytical mindset with a sharp eye for technical details.
• Valid LinkedIn profile to verify your degree and background during screening.
• PayPal account to receive payments from our clients

Responsibilities

• AI Evaluation & Ranking: comparing multiple AI-generated responses to technical prompts and ranking them based on accuracy, logic, and safety.
• Scientific Review: reviewing CS research papers alongside AI-generated summaries and graphical abstracts to ensure scientific integrity.
• Fact-Checking: identifying inaccuracies where the AI has misinterpreted technical data, formulas, or research findings.
• RLHF (Reinforcement Learning from Human Feedback): providing the human “ground truth” to help models align with professional standards in software engineering and data science.
• Code & Logic Verification: auditing AI-generated code snippets or architectural diagrams for structural and functional correctness.

Skills

Analytical mindset

Code review

Research interpretation

Technical reasoning

Education

BSc in Computer Science

Job description

Prolific is seeking Computer Science Specialists to join its Expert Network to train and evaluate AI models. You’ll complete a short skills test; if successful, you’ll be invited to participate and paid to help AI understand scientific data.

Roles involve evaluating AI outputs, ranking responses, and verifying code and research papers. Pay rates can reach up to $60/hr, with the possibility to work from home and flexible hours.