Jobs in Poole, United Kingdom
Chinese LLM Evaluator
Remote Jobs
Work From Home Customer Service Representative - Part Time
TowardJobs
Senior Pensions Administrator (Contract)
IDEX Consulting
AI Trainer - Medical Doctors
Prolific
SMB Sales lead EMEA - BeReal
BeReal.
Work at Home Data Entry Clerk (Remote)
TowardJobs
Remote Data Entry Clerk - Work at Home
TowardJobs
IT Business Analyst (Endur Specialist)
Arthur Lawrence
Connect with headhunters to apply for similar jobsMedia Investment Director (Remote) at Independent Digital Performance Media Agency
Grey Matter Recruitment
Director - Business Development
UniQuest
Mgr-Consulting Services-Business Consulting EMEA
TELUS Agriculture & Consumer Goods
Work From Home Customer Service Representative - Part Time
TowardJobs
Memory Layout Engineer
Chipright
Training Manager
Yes Care Group
Senior Accredited Clinical Coder
NHS
Academic Sales Consultant – SW – Business & Economics
TELFER PARTNERS
Corporate Counsel - AI Trainer
DataAnnotation
Appellate Attorney - AI Trainer
DataAnnotation
Attorney - AI Trainer
DataAnnotation
Content Developer (Chemistry) - AI Trainer
DataAnnotation
Consulting Lead – Data Centre and AI
NTT
Health and Care Intelligence Specialist Level 7 Apprenticeship
NHS
Chinese LLM Evaluator
Job summary
A remote evaluation project is seeking evaluators to review multilingual AI outputs. Candidates must have native-level fluency in a target language and strong English skills. Responsibilities include rating AI-generated replies based on tone and fluency. This is a project-based role with an hourly rate of $3.70, allowing for flexible remote work from anywhere.
Qualifications
- Evaluate model replies based on Tone or Fluency.
- Assess overall quality, correctness, and naturalness.
- Provide rationales for extreme ratings.
Responsibilities
- Review model replies and rate using a five-point scale.
- Determine helpfulness, insightfulness, and engagement.
- Flag tonal mismatches and assess grammatical accuracy.
Skills
Join Project Spearmint, a multilingual AI response evaluation project reviewing large language model (LLM) outputs in different languages, focused on either Tone or Fluency. Native-level fluency in a target language, along with strong English comprehension, is required.
As an evaluator, you will review short, pre-segmented datasets and assess model-generated replies based on specific quality dimensions. Your input will help validate evaluation frameworks and establish baseline quality metrics for future model development.
- Evaluate model replies in your native language based on either Tone or Fluency.
- Assess the overall quality, correctness, and naturalness of responses.
- Read the user prompt and two model replies, then rate each using a five-point scale.
- Provide brief rationales for any extreme ratings.
Batch 1 - Tone: Determine whether replies are helpful, insightful, engaging, and fair. Flag formality mismatches, condescension, bias, or other tonal issues.
Batch 2 - Fluency: Assess grammatical accuracy, clarity, coherence, and natural flow.
This is a project-based opportunity with CrowdGen, where you will join the CrowdGen Community as an Independent Contractor. If selected, you will receive an email from CrowdGen regarding the creation of an account using your application email address. You will need to log in to this account, reset your password, complete the setup requirements, and proceed with your application for this role.
Make an impact on the future of AI - apply today and contribute from the comfort of your home.
The hourly rate for this position is $3.70.
The location for this role is remote, and you can work from anywhere.
* The salary benchmark is based on the target salaries of market leaders in their relevant sectors. It is intended to serve as a guide to help Premium Members assess open positions and to help in salary negotiations. The salary benchmark is not provided directly by the company, which could be significantly higher or lower.
job faster
Follow us
