Academic Abstract Reviewer – PhD in CS,ML/AI or Statistics

Job title:

Academic Abstract Reviewer – PhD in CS,ML/AI or Statistics

Company

Upwork

Job description

Company DescriptionUpwork has partnered with an Enterprise client, a global Data Engineering company delivering AI to many of the world’s most prestigious companies. They provide AI-enabled software platforms and managed services for AI data collection/annotation, AI digital transformation, and industry-specific business processes.They are seeking freelancers with a PhD in Computer Science, Machine Learning, or Statistics to participate in a survey aimed at evaluating academic abstracts and improving the effectiveness and trustworthiness of AI-generated summaries. As a participant, you will act as an abstract reviewer, critically assessing content based on provided project guidelines. Your contribution will help advance responsible AI (RAI) and cutting-edge research involving large language models (LLMs).This project may take up to 2.5 hours to complete (including a 30-min orientation session, plus 2 hours for the survey), and there’s a potential for ongoing work beyond this initial contract. The survey must be completed in one sitting, and can be completed at any time of your choosing.Participants will receive credentials with a unique identifier for completing the survey, ensuring anonymity. The client will also provide a point of contact to address any technical difficulties.Job DescriptionThe task consists of three components:1. OrientationA live 30-minute session for reviewing project guidelines, answering preliminary questions (such as”What’s your field of study?”), and discussing any questions about the project. The date and time haven’t yet been determined, but the client will provide documents for you to review on your own time as well in case you’re unavailable to join.2. Abstract EvaluationReviewing three short abstracts and answering five questions per abstract using a Likert Scale. No need to read or reference the full paper provided —only the abstract.3. Abstract ComparisonComparing three abstracts side by side and answering four related questions.The maximum budget for this one-time, fixed-price project is $175-200. You’ll be asked via screening questions to provide your bid.Qualifications

• Fluency in English with strong speaking & writing skills
• PhD in Computer Science, Machine Learning, or Statistics
• Participants must have submitted or reviewed an academic paper on Computer Science or Machine Learning to a machine learning conference, or a CS/ML journal
• Familiarity with academic papers on LLMs, AI, and/or machine learning
• Only freelancers in the United States or Canada are eligible for hire

Additional InformationNext steps:

• Submit your proposal
• Submit the Google Form that will be sent to you via Messages
• If you receive a contract offer, provide documentation (if requested) to the Upwork Compliance team
• Accept your offer
• The hiring manager will contact you with information about the orientation session, project guidelines, reference materials, survey credentials, and other details for next steps

There is no test task or assessment required for this project.This Enterprise client utilizes Upwork Compliance. If you receive a contract offer, you may be asked via email to provide documentation in order for the worker classification review to be completed.

Expected salary

Location

Toronto, ON

Job date

Thu, 20 Mar 2025 23:40:56 GMT

To help us track our recruitment effort, please indicate in your email/cover letter where (jobsnearcanada.com) you saw this job posting.