Academic Abstract Reviewer - PhD in CS,ML/AI or Statistics

Upwork; Toronto; Remote; CAD 80,000 - 100,000; Full time

Job summary

Join a forward-thinking company as an Academic Abstract Reviewer, where your expertise in Computer Science, Machine Learning, or Statistics will be invaluable. This role involves evaluating academic abstracts to enhance the effectiveness of AI-generated summaries, contributing to responsible AI research. With a flexible schedule and the potential for ongoing work, you'll engage in meaningful tasks that shape the future of AI. Your insights will help ensure the integrity of AI technologies while working alongside prestigious clients in the industry. This is an excellent opportunity for those passionate about advancing AI and academic research.

Qualifications

• Must have submitted or reviewed an academic paper in CS or ML.
• Familiarity with academic papers on LLMs and AI is required.

Responsibilities

• Participate in a survey evaluating academic abstracts.
• Review three abstracts and answer questions using a Likert Scale.

Skills

Fluency in English

Strong speaking skills

Strong writing skills

Understanding of academic papers

Education

PhD in Computer Science

PhD in Machine Learning

PhD in Statistics

Job description

Academic Abstract Reviewer - PhD in CS, ML/AI or Statistics

4 days ago Be among the first 25 applicants

Upwork has partnered with an Enterprise client, a global Data Engineering company delivering AI to many of the world’s most prestigious companies. They provide AI-enabled software platforms and managed services for AI data collection/annotation, AI digital transformation, and industry-specific business processes.

They are seeking freelancers with a PhD in Computer Science, Machine Learning, or Statistics to participate in a survey aimed at evaluating academic abstracts and improving the effectiveness and trustworthiness of AI-generated summaries. As a participant, you will act as an abstract reviewer, critically assessing content based on provided project guidelines. Your contribution will help advance responsible AI (RAI) and cutting-edge research involving large language models (LLMs).

This project may take up to 2.5 hours to complete (including a 30-min orientation session, plus 2 hours for the survey), and there’s a potential for ongoing work beyond this initial contract. The survey must be completed in one sitting, and can be completed at any time of your choosing.

Participants will receive credentials with a unique identifier for completing the survey, ensuring anonymity. The client will also provide a point of contact to address any technical difficulties.

Job Description
The task consists of three components:

1. Orientation
   A live 30-minute session for reviewing project guidelines, answering preliminary questions (such as "What’s your field of study?"), and discussing any questions about the project. The date and time haven’t yet been determined, but the client will provide documents for you to review on your own time as well in case you’re unavailable to join.
2. Abstract Evaluation
   Reviewing three short abstracts and answering five questions per abstract using a Likert Scale. No need to read or reference the full paper provided —only the abstract.
3. Abstract Comparison
   Comparing three abstracts side by side and answering four related questions.

The maximum budget for this one-time, fixed-price project is $175-200. You’ll be asked via screening questions to provide your bid.

Qualifications

• Fluency in English with strong speaking & writing skills
• PhD in Computer Science, Machine Learning, or Statistics
• Participants must have submitted or reviewed an academic paper on Computer Science or Machine Learning to a machine learning conference, or a CS/ML journal
• Familiarity with academic papers on LLMs, AI, and/or machine learning
• Only freelancers in the United States or Canada are eligible for hire

Additional Information
Next steps:

• Submit your proposal
• Submit the Google Form that will be sent to you via Messages
• If you receive a contract offer, provide documentation (if requested) to the Upwork Compliance team
• Accept your offer
• The hiring manager will contact you with information about the orientation session, project guidelines, reference materials, survey credentials, and other details for next steps

There is no test task or assessment required for this project.

This Enterprise client utilizes Upwork Compliance. If you receive a contract offer, you may be asked via email to provide documentation in order for the worker classification review to be completed.