AI Evaluation Specialist - Remote, Paid Projects

prolificacademicltd; EE. UU.; A distancia; USD 41.000 - 83.000; Jornada completa

Descripción de la vacante

prolificacademicltd seeks contributors to evaluate and improve AI systems through paid, project-based tasks. You will assess technical answers, review research summaries, and critique AI-generated code or diagrams after a skills assessment.

Applicants should hold a bachelor's in computer science or related field, be able to read research papers, analyze algorithms and code logic, and deliver expert judgments to align models with software engineering and data science standards.

Formación

• Bachelor’s degree in computer science or a closely related technical field.
• Ability to read research papers, understand complex algorithms, and evaluate code logic.
• Strong analytical judgment and attention to technical inaccuracies and flawed reasoning.
• A professional profile that can be used to verify education and relevant background during screening.
• A PayPal account to receive payments.
• Availability for some paid tasks requiring an uninterrupted hour; other tasks may be shorter.

Responsabilidades

• Compare AI responses to technical prompts for accuracy, reasoning, and safety, then rank them using evaluation guidance.
• Review computer science research alongside generated summaries and visual abstracts for faithful representation of the findings.
• Check technical data, formulas, algorithms, and research claims, flagging errors or unsupported conclusions.
• Assess code snippets and architecture diagrams for logical, structural, and functional correctness.
• Provide expert judgments that help align models with professional expectations in software engineering and data science.

Conocimientos

Research paper reading

Code evaluation

Analytical judgment

Professional profile verification

Payment readiness (PayPal)

Task-focused availability

Educación

Bachelor’s degree in computer science or closely related field

Descripción del empleo

prolificacademicltd seeks contributors to evaluate and improve AI systems through paid, project-based tasks. You will assess technical answers, review research summaries, and critique AI-generated code or diagrams after a skills assessment.

Applicants should hold a bachelor's in computer science or related field, be able to read research papers, analyze algorithms and code logic, and deliver expert judgments to align models with software engineering and data science standards.