Remote AI Evaluation & CS Research Reviewer (Up to $60/hr)

prolificacademicltd; United States; Remote; USD 50,000 - 83,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Job summary

prolificacademicltd is seeking individuals to apply CS expertise for paid evaluation and research support tasks. After a brief skills assessment, you may be invited to complete assignments reviewing technical material and judging whether AI-generated answers are accurate, logical, and safe.

Assignments are flexible with remote participation and hours that fit your schedule; some tasks may require up to an uninterrupted hour.

Qualifications

• Bachelor's degree in computer science or closely related technical field.
• Ability to read research papers, understand complex algorithms and assess code logic.
• Strong analytical judgment and attention to technical inaccuracies and reasoning flaws.
• LinkedIn profile for education and professional background verification.
• PayPal account to receive payments.

Responsibilities

• Compare AI responses to technical prompts and rank them for correctness, reasoning quality and safety.
• Review computer science research papers and AI-produced summaries for fidelity to underlying work.
• Check technical claims, formulas and findings, flagging errors or misinterpretations.
• Assess generated code and architecture diagrams for sound structure and function.
• Provide expert feedback to align AI systems with software engineering and data science standards.

Education

Bachelor's degree in computer science or related technical field

Job description

prolificacademicltd is seeking individuals to apply CS expertise for paid evaluation and research support tasks. After a brief skills assessment, you may be invited to complete assignments reviewing technical material and judging whether AI-generated answers are accurate, logical, and safe.

Assignments are flexible with remote participation and hours that fit your schedule; some tasks may require up to an uninterrupted hour.