AI Training Evaluator – CS Grad (Remote, Austin)

prolificacademicltd; EE. UU.; A distancia; USD 50.000 - 83.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Remote work in Austin, Texas

Flexible hours

Descripción de la vacante

ProlificAcademic Ltd is seeking a role focusing on applying computer science knowledge to train and evaluate AI systems, emphasizing technical prompts, summaries, code reviews, and diagram assessment. A short screening assessment determines eligibility for the expert pool.

The work is remote with flexible hours and base rates up to $60 per hour, varying by skills and experience. You will compare AI outputs, review research papers, identify errors in data, formulas, or findings, and provide

Formación

• Bachelor’s degree in computer science or a closely related technical field.
• Ability to interpret research papers, understand complex algorithms, and review code logic.
• Strong analytical judgment and attention to technical inaccuracies or flawed reasoning.
• A valid LinkedIn profile for verification of education and background during screening.
• A PayPal account for receiving payments.
• Successful completion of a short skills assessment.

Responsabilidades

• Compare AI responses to technical prompts and rank them for accuracy, logic, and safety.
• Review computer science papers alongside generated summaries and graphical abstracts.
• Identify misread data, formulas, or research findings in AI outputs.
• Check generated code and architecture diagrams for functional and structural correctness.
• Provide expert judgments that help align model outputs with professional standards.

Conocimientos

Interpret research papers

Understand complex algorithms

Review code logic

Educación

Bachelor’s degree in Computer Science

Descripción del empleo

ProlificAcademic Ltd is seeking a role focusing on applying computer science knowledge to train and evaluate AI systems, emphasizing technical prompts, summaries, code reviews, and diagram assessment. A short screening assessment determines eligibility for the expert pool.

The work is remote with flexible hours and base rates up to $60 per hour, varying by skills and experience. You will compare AI outputs, review research papers, identify errors in data, formulas, or findings, and provide