Remote CS Researcher & AI Model Evaluator

prolificacademicltd; Stati Uniti; Remoto; USD 50.000 - 83.000; Tempo pieno

Vantaggi offerti da questo lavoro

Remote work

Descrizione del lavoro

prolificacademicltd is seeking contributors to evaluate AI model outputs by comparing technical questions with precise accuracy, reasoning, and safety. Review CS research alongside AI summaries for fidelity to the source and identify errors in interpretations of formulas and findings.

You will assess code and architecture diagrams for correctness and provide expert feedback to improve models used in software engineering and data science.

Competenze

• Bachelor's degree in CS or a closely related technical field.
• Ability to read research papers and evaluate code logic.
• Strong analytical judgment and attention to technical inaccuracies.
• Professional profile verifiable during screening.
• A PayPal account is required for task payments.
• Availability for one uninterrupted hour; many tasks may be shorter.

Mansioni

• Compare AI responses to technical questions and rate accuracy, reasoning, and safety.
• Review CS research alongside AI summaries for fidelity to the source.
• Identify errors in interpretations of algorithms and findings.
• Assess AI-generated code and architecture diagrams for logical and structural correctness.
• Provide expert feedback that helps improve models used in software engineering and data science.

Conoscenze

Analytical judgment

Code evaluation

Reading research papers

Evaluate AI model outputs

Formazione

Bachelor's degree in computer science or closely related technical field

Descrizione del lavoro

prolificacademicltd is seeking contributors to evaluate AI model outputs by comparing technical questions with precise accuracy, reasoning, and safety. Review CS research alongside AI summaries for fidelity to the source and identify errors in interpretations of formulas and findings.

You will assess code and architecture diagrams for correctness and provide expert feedback to improve models used in software engineering and data science.