AI Evaluation & CS Research Expert (Remote, Flexible)

prolificacademicltd; United States; Remote; USD 50,000 - 83,000; Full time

Benefits offered by this job

Remote work

Pay per hour up to $60

Job summary

Prolific Academic Ltd is seeking experts to contribute computer science expertise to the evaluation and improvement of AI systems through paid, project-based tasks. Work may include assessing technical answers, checking research summaries, and reviewing AI-generated code or diagrams; an initial skills assessment is required before joining the expert pool.

Responsibilities include comparing AI responses to technical prompts, reviewing research findings for fidelity, checking formulas and

Qualifications

• Bachelor’s degree in computer science or related field.
• Ability to read research papers and evaluate complex algorithms.
• Strong analytical judgment and attention to inaccuracies.
• Professional profile for screening.
• PayPal account to receive payments.
• Availability for some tasks requiring an uninterrupted hour.

Responsibilities

• Evaluate AI responses for accuracy, reasoning, and safety.
• Review research summaries and visual abstracts for fidelity.
• Check data, formulas, and research claims for errors.
• Assess code snippets and diagrams for correctness.
• Provide expert judgments to align models with software engineering expectations.

Skills

Analytical thinking

Reading research papers

Code evaluation

Education

Bachelor's degree in Computer Science

Job description

Prolific Academic Ltd is seeking experts to contribute computer science expertise to the evaluation and improvement of AI systems through paid, project-based tasks. Work may include assessing technical answers, checking research summaries, and reviewing AI-generated code or diagrams; an initial skills assessment is required before joining the expert pool.

Responsibilities include comparing AI responses to technical prompts, reviewing research findings for fidelity, checking formulas and