Computer Sciences - Graduates - AI Training - Memphis, US

prolificacademicltd; Stati Uniti; Remoto; USD 68.000 - 97.000; Tempo pieno

Vantaggi offerti da questo lavoro

Flexible remote participation

Pay-per-task payments up to $60 per hr

Descrizione del lavoro

Prolific Academic Ltd is seeking experts to evaluate AI systems through paid, project-based tasks. You will compare AI responses to technical prompts, review research, and assess code or diagrams for correctness, with an initial skills assessment required for joining the expert pool.

Responsibilities include ranking responses, verifying research summaries, and flagging inaccuracies. A bachelor’s degree in CS is required, and PayPal is used for payments.

Competenze

• Bachelor’s degree in computer science or a closely related technical field.
• Ability to read research papers and evaluate algorithms and code logic.
• Strong analytical judgment and attention to technical inaccuracies.

Mansioni

• Compare AI responses to technical prompts for accuracy, reasoning, and safety, then rank them using evaluation guidance.
• Review computer science research alongside generated summaries and visual abstracts for faithful representation of the findings.
• Check technical data, formulas, algorithms, and research claims, flagging errors or unsupported conclusions.
• Assess code snippets and architecture diagrams for logical, structural, and functional correctness.
• Provide expert judgments that help align models with professional expectations in software engineering and data science.

Conoscenze

Analytical judgment

Attention to technical inaccuracies

Code evaluation

Formazione

Bachelor’s degree in Computer Science

Descrizione del lavoro

Role overview

Contribute computer science expertise to the evaluation and improvement of AI systems through paid, project-based tasks. Work may include assessing technical answers, checking research summaries, and reviewing AI-generated code or diagrams; an initial skills assessment is required before joining the expert pool.

Responsibilities

• Compare AI responses to technical prompts for accuracy, reasoning, and safety, then rank them using evaluation guidance.
• Review computer science research alongside generated summaries and visual abstracts for faithful representation of the findings.
• Check technical data, formulas, algorithms, and research claims, flagging errors or unsupported conclusions.
• Assess code snippets and architecture diagrams for logical, structural, and functional correctness.
• Provide expert judgments that help align models with professional expectations in software engineering and data science.

Requirements

• A bachelor’s degree in computer science or a closely related technical field.
• Ability to read research papers, understand complex algorithms, and evaluate code logic.
• Strong analytical judgment and attention to technical inaccuracies and flawed reasoning.
• A professional profile that can be used to verify education and relevant background during screening.
• A PayPal account to receive payments.
• Availability for some paid tasks requiring an uninterrupted hour; other tasks may be shorter.

Benefits and work setup

• Flexible, remote participation, with work offered through individual paid tasks rather than a stated fixed schedule.
• Task rates may reach $60 per hour depending on the project, skills, and experience; this is not a guaranteed rate or volume of work.
• Screening includes a short assessment, described as taking about 10-15 minutes.