Remote AI Training & Evaluation Specialist — CS

Prolific; United States; Remote; USD 50,000 - 83,000; Full time

Job summary

Prolific is seeking Computer Science Specialists to join our Expert Network to help train and evaluate AI models. If you have a background in CS research or technical analysis, you’ll complete a quick 10‑ to 15‑minute test to assess your skills.

If successful, you’ll be invited to join Prolific as a participant, where you’ll get paid to help AI understand and summarize complex scientific data. Researchers looking for your skills tend to pay up to $60/hr, depending on skills and experience level.

Qualifications

• Educational background: BSc in Computer Science or closely related field.
• Technical literacy: interpret research papers, understand algorithms, review code logic.
• Analytical mindset with attention to technical accuracy.
• Professional verification: a valid LinkedIn profile for background checks.
• Payment setup: PayPal account to receive payments.

Responsibilities

• AI Evaluation & Ranking: compare AI-generated responses to prompts and rank by accuracy, logic, and safety.
• Scientific Review: assess CS research papers and AI-generated summaries for integrity.
• Fact-Checking: identify inaccuracies in data, formulas, or findings.
• RLHF: provide human ground truth to align models with standards.
• Code & Logic Verification: audit AI-generated code or diagrams for correctness.

Job description

Prolific is seeking Computer Science Specialists to join our Expert Network to help train and evaluate AI models. If you have a background in CS research or technical analysis, you’ll complete a quick 10‑ to 15‑minute test to assess your skills.

If successful, you’ll be invited to join Prolific as a participant, where you’ll get paid to help AI understand and summarize complex scientific data. Researchers looking for your skills tend to pay up to $60/hr, depending on skills and experience level.