Remote AI Evaluation & Research Associate (CS Grad)

prolificacademicltd; United States; Remote; USD 68,000 - 97,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Job summary

prolificacademicltd is seeking individuals to perform paid evaluation and research support tasks to help improve AI systems. After a brief skills assessment, you may review technical material and judge whether AI-produced answers are accurate, logical, and safe.

You will also review research papers and AI summaries for fidelity to the underlying work, and check formulas or findings for correctness. Remote work with flexible hours is offered; some assignments may take up to an uninterrupted hour.

Qualifications

• Must read research papers and assess algorithms.
• Ability to review code logic and architectures for correctness.
• Strong analytical judgment and attention to technical inaccuracies.

Responsibilities

• Compare AI responses to prompts and rank for correctness, reasoning, and safety.
• Review CS research papers and AI summaries for fidelity to the work.
• Check technical claims, formulas, and findings for errors or misinterpretations.
• Assess generated code and architecture diagrams for soundness.

Skills

Reading research papers

Assessing code logic

Analytical judgment

Attention to technical inaccuracies

Education

Bachelor's degree in computer science

Job description

prolificacademicltd is seeking individuals to perform paid evaluation and research support tasks to help improve AI systems. After a brief skills assessment, you may review technical material and judge whether AI-produced answers are accurate, logical, and safe.

You will also review research papers and AI summaries for fidelity to the underlying work, and check formulas or findings for correctness. Remote work with flexible hours is offered; some assignments may take up to an uninterrupted hour.