AI Evaluation & Research Associate - Remote & Flexible Hours

prolificacademicltd; United States; Remote; USD 68,000 - 97,000; Full time

Job summary

Prolific Academic Ltd. invites applications from qualified candidates to perform paid evaluation and research support tasks that help improve AI systems.

After a short skills assessment, you may review technical material and judge whether AI-generated answers are accurate, logical, and safe, with some tasks requiring a solid hour of uninterrupted focus. Remote participation with flexible hours is offered; compensation can be up to $60 per hour depending on skills and experience.

Qualifications

• Bachelor's degree in computer science or a closely related technical field.
• Ability to read research papers and assess complex algorithms.
• Strong analytical judgment to identify inaccuracies and flawed reasoning.
• LinkedIn profile for education and background verification.
• PayPal account required to receive payments.
• Willingness to complete tasks lasting up to one hour.

Responsibilities

• Compare AI responses to technical prompts and rank them for correctness, reasoning quality, and safety.
• Review research papers and AI-produced summaries for fidelity to the underlying work.
• Check technical claims, formulas, and findings, flagging errors or misinterpretations.
• Assess generated code and architecture diagrams for sound structure and function.
• Provide expert feedback to align AI systems with professional software engineering and data science standards.

Skills

Analytical reasoning

Code comprehension

Research reading

Attention to detail

Education

Bachelor's degree in Computer Science

Job description

Prolific Academic Ltd. invites applications from qualified candidates to perform paid evaluation and research support tasks that help improve AI systems.

After a short skills assessment, you may review technical material and judge whether AI-generated answers are accurate, logical, and safe, with some tasks requiring a solid hour of uninterrupted focus. Remote participation with flexible hours is offered; compensation can be up to $60 per hour depending on skills and experience.