Senior AI Evaluation Engineer (CS Specialist) – Remote

Prolific; Wales; Remote; GBP 51,000 - 73,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Competitive pay rates

Job summary

Prolific is seeking Computer Science Specialists to join its Expert Network. You will be paid to evaluate and rank AI outputs, review scientific material, and verify logic and code correctness, contributing to robust model development.

Successful applicants complete a short test and, if invited, join Prolific to work from home with flexible hours. Pay scales up to $60/hr, commensurate with skills and experience.

Qualifications

• BSc (Bachelor of Science) in Computer Science or related field.
• Ability to interpret research papers and understand complex algorithms.
• Analytical mindset with attention to technical details.
• Professional verification via a LinkedIn profile during screening.
• Must have a PayPal account to receive payment.

Responsibilities

• AI Evaluation & Ranking: compare AI outputs and rank by accuracy and safety.
• Scientific Review: assess CS research papers and AI summaries for integrity.
• Fact-Checking: spot inaccuracies in data, formulas, or findings.
• RLHF: provide human ground truth to align models with standards.
• Code & Logic Verification: audit generated code and diagrams for correctness.

Skills

Analytical mindset

Technical literacy

Code review

LinkedIn verification

Education

BSc in Computer Science

Tools

PayPal account

Job description

Prolific is seeking Computer Science Specialists to join its Expert Network. You will be paid to evaluate and rank AI outputs, review scientific material, and verify logic and code correctness, contributing to robust model development.

Successful applicants complete a short test and, if invited, join Prolific to work from home with flexible hours. Pay scales up to $60/hr, commensurate with skills and experience.