Academic Abstract Reviewer - PhD in CS,ML / AI or Statistics

Upwork; Toronto; Remote; CAD 80,000 - 100,000; Full time

Job summary

A leading company is seeking freelancers with a PhD in Computer Science, Machine Learning, or Statistics to evaluate academic abstracts. This project involves reviewing abstracts and providing feedback to improve AI-generated summaries. The task includes a 30-minute orientation and can be completed remotely at your convenience.

Qualifications

• Must have submitted or reviewed an academic paper on CS or ML.
• Familiarity with LLMs, AI, and machine learning is required.

Responsibilities

• Participate in a survey evaluating academic abstracts.
• Review three short abstracts and answer related questions.
• Attend a 30-minute orientation session.

Skills

Fluency in English

Strong speaking skills

Strong writing skills

Familiarity with academic papers

Education

PhD in Computer Science

PhD in Machine Learning

PhD in Statistics

Job description

Academic Abstract Reviewer - PhD in CS, ML / AI or Statistics

4 days ago Be among the first 25 applicants

Upwork has partnered with an Enterprise client, a global Data Engineering company delivering AI to many of the world’s most prestigious companies. They provide AI-enabled software platforms and managed services for AI data collection / annotation, AI digital transformation, and industry-specific business processes.

They are seeking freelancers with a PhD in Computer Science, Machine Learning, or Statistics to participate in a survey aimed at evaluating academic abstracts and improving the effectiveness and trustworthiness of AI-generated summaries. As a participant, you will act as an abstract reviewer, critically assessing content based on provided project guidelines. Your contribution will help advance responsible AI (RAI) and cutting-edge research involving large language models (LLMs).

This project may take up to 2.5 hours to complete (including a 30-min orientation session, plus 2 hours for the survey), and there’s a potential for ongoing work beyond this initial contract. The survey must be completed in one sitting, and can be completed at any time of your choosing.

Participants will receive credentials with a unique identifier for completing the survey, ensuring anonymity. The client will also provide a point of contact to address any technical difficulties.

Job Description

The task consists of three components :

1. Orientation

A live 30-minute session for reviewing project guidelines, answering preliminary questions (such as "What’s your field of study?"), and discussing any questions about the project. The date and time haven’t yet been determined, but the client will provide documents for you to review on your own time as well in case you’re unavailable to join.

1. Abstract Evaluation

Reviewing three short abstracts and answering five questions per abstract using a Likert Scale. No need to read or reference the full paper provided —only the abstract.

1. Abstract Comparison

Comparing three abstracts side by side and answering four related questions.

The maximum budget for this one-time, fixed-price project is $175-200. You’ll be asked via screening questions to provide your bid.

Qualifications

• Fluency in English with strong speaking & writing skills
• PhD in Computer Science, Machine Learning, or Statistics
• Participants must have submitted or reviewed an academic paper on Computer Science or Machine Learning to a machine learning conference, or a CS / ML journal
• Familiarity with academic papers on LLMs, AI, and / or machine learning
• Only freelancers in the United States or Canada are eligible for hire

Additional Information

Next steps :

• Submit the Google Form that will be sent to you via Messages
• If you receive a contract offer, provide documentation (if requested) to the Upwork Compliance team
• Accept your offer
• The hiring manager will contact you with information about the orientation session, project guidelines, reference materials, survey credentials, and other details for next steps

There is no test task or assessment required for this project.

This Enterprise client utilizes Upwork Compliance. If you receive a contract offer, you may be asked via email to provide documentation in order for the worker classification review to be completed.