CS Grad for AI Model Evaluation - Remote & Flexible

prolificacademicltd; United States; Remote; USD 28,000 - 83,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Diverse assignments

Job summary

Prolific Academic Ltd in the United States seeks individuals to contribute computer science expertise to training and evaluating AI models through paid, project-based tasks. You will review technical answers, assess papers, and verify generated code and diagrams.

After a short skills assessment, successful applicants can join a participant network and take on available assignments. Responsibilities include comparing AI outputs, reviewing research summaries, and identifying errors in explanations

Qualifications

• A bachelor’s degree in computer science or related field.
• Ability to understand complex algorithms and assess code logic.
• Strong analytical judgment and attention to technical inaccuracies.

Responsibilities

• Compare AI responses to technical questions and rate accuracy and safety.
• Review papers and generated summaries for fidelity to research.
• Find errors in explanations of data, formulas, or algorithms.
• Provide expert feedback to improve model responses in software engineering and data science.
• Check generated code snippets and diagrams for correctness.

Skills

Algorithm analysis

Code reasoning

Research interpretation

Education

Bachelor’s degree in Computer Science

Job description

Prolific Academic Ltd in the United States seeks individuals to contribute computer science expertise to training and evaluating AI models through paid, project-based tasks. You will review technical answers, assess papers, and verify generated code and diagrams.

After a short skills assessment, successful applicants can join a participant network and take on available assignments. Responsibilities include comparing AI outputs, reviewing research summaries, and identifying errors in explanations