AI Training & Evaluation Specialist — CS Grad, Fort Worth

Prolific Academic Ltd; United States; Remote; USD 68,000 - 97,000; Full time

Job summary

Prolific is seeking Computer Science Specialists to join its Expert Network to help train and evaluate AI models. After a quick 10–15 minute test, you may be invited to join Prolific as a participant and get paid to help AI understand complex data.

Researchers looking for your skills tend to pay up to $60/hr, depending on skills and experience. Tasks require one hour of uninterrupted work, though many are shorter. Flexible hours and work from home are available.

Qualifications

• Educational background: BSc in Computer Science or closely related technical field.
• Technical literacy: interpret research papers, understand algorithms, review code logic.
• Analytical mindset with high cognitive competency and attention to technical flaws.
• Professional verification: valid LinkedIn profile for background checks.
• PayPal account required to receive payments.

Responsibilities

• AI Evaluation & Ranking: compare AI-generated responses and rank by accuracy and safety.
• Scientific Review: assess CS research papers and AI summaries for integrity.
• Fact-Checking: identify inaccuracies in data, formulas, or findings.
• RLHF: provide human feedback to align models with software engineering standards.
• Code & Logic Verification: audit AI-generated code and diagrams for correctness.

Skills

Technical literacy

Analytical mindset

Code & logic review

Research papers

LinkedIn verification

PayPal payment

Education

BSc in Computer Science

Job description

Prolific is seeking Computer Science Specialists to join its Expert Network to help train and evaluate AI models. After a quick 10–15 minute test, you may be invited to join Prolific as a participant and get paid to help AI understand complex data.

Researchers looking for your skills tend to pay up to $60/hr, depending on skills and experience. Tasks require one hour of uninterrupted work, though many are shorter. Flexible hours and work from home are available.