AI Model Evaluator — Computer Science Expert (Remote, Paid)

prolificacademicltd; United States; Remote; USD 68,000 - 97,000; Full time

Benefits offered by this job

Remote work

Flexible hours

PayPal payments

Job summary

Prolific Academic Ltd is offering paid, project-based tasks that utilize your computer science expertise to train and evaluate AI models. After a brief skills assessment, you can join a participant network and select available assignments, often paying up to $60 per hour.

Tasks may include validating technical explanations, reviewing research summaries, and verifying generated code and diagrams. The role supports remote work with flexible hours.

Qualifications

• Bachelor's degree in computer science or a closely related technical field.
• Ability to understand complex algorithms, assess code logic, and interpret research papers.
• Strong analytical judgment and attention to technical inaccuracies or flawed reasoning.
• Professional profile that can verify education and background.

Responsibilities

• Compare AI responses to technical questions and rate their accuracy, reasoning, and safety.
• Review computer science papers alongside generated summaries and visual abstracts for fidelity to the research.
• Find errors in explanations of technical data, formulas, algorithms, or findings.
• Provide expert feedback to improve model responses in software engineering and data science.
• Check generated code snippets and architecture diagrams for correctness.

Skills

Understanding algorithms

Assessing code logic

Interpreting research papers

Analytical judgment

Education

Bachelor's degree in computer science or related field

Job description

Prolific Academic Ltd is offering paid, project-based tasks that utilize your computer science expertise to train and evaluate AI models. After a brief skills assessment, you can join a participant network and select available assignments, often paying up to $60 per hour.

Tasks may include validating technical explanations, reviewing research summaries, and verifying generated code and diagrams. The role supports remote work with flexible hours.