Remote CS PhD Expert: AI Model Evaluation & Feedback

prolificacademicltd

United States

Remote

USD 170,000 - 243,000

Full time

10 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Remote work

Flexible hours

Up to $150/hour

Job summary

Prolific Academic Ltd. is seeking experts to apply advanced computer science techniques to train and assess AI models. You will narrate your approach aloud while tackling challenging CS problems and judge whether model answers are accurate, complete, and well reasoned.

A skills assessment is part of the selection process. Responsibilities include recording your screen, reviewing AI-generated answers for depth and correctness, comparing candidates, and providing improved explanations or feedback

Qualifications

Hold, or be pursuing, a PhD in computer science or a related discipline.
Demonstrate strong subject expertise and the ability to solve complex technical problems.
Be comfortable thinking aloud and recording your task approach.
Maintain close attention to detail during focused work, including sessions of up to an hour.
Have reliable, fast internet access, a computer, and a PayPal account for payment.
Pass a skills assessment for the AI tasks.

Responsibilities

Narrate your reasoning while solving challenging computer science problems.
Record your screen as you complete assigned tasks.
Review AI-generated technical answers for correctness, depth, and quality of reasoning.
Compare candidate answers, select the strongest, and explain the choice.
Write improved examples, explanations, or structured feedback when responses need correction.