AI Output Quality Evaluator & Criteria Writer

Randstad Canada

Woodstock

On-site

CAD 45,000 - 65,000

Full time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Randstad Canada in Woodstock is seeking detail-oriented evaluators to assess AI outputs, text, images, video and documents against detailed criteria. You will identify quality issues, document clear judgments, and contribute to improving the accuracy of automated systems.

Ideal candidates write clearly, think critically, and can justify every decision with precise reasoning, following established guidelines independently.

Qualifications

  • Strong readers and writers with sound judgment.
  • Comfortable evaluating creative or technical work against a set of criteria.
  • Takes quality seriously and catches what others miss.
  • Can follow detailed written guidelines independently.

Responsibilities

  • Evaluate outputs from AI models, text, images, video, and documents against detailed criteria.
  • Assess quality, spot errors and inconsistencies, and write clear, well-reasoned justifications for your judgments.
  • Help improve systems by providing feedback on evaluations.

Skills

Clear writing
Critical thinking
Justify judgments
Attention to detail

Job description

Randstad Canada in Woodstock is seeking detail-oriented evaluators to assess AI outputs, text, images, video and documents against detailed criteria. You will identify quality issues, document clear judgments, and contribute to improving the accuracy of automated systems.

Ideal candidates write clearly, think critically, and can justify every decision with precise reasoning, following established guidelines independently.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Content Quality Evaluator
AI Content Quality Evaluator

Crossing Hurdles • Canada

On-site
CAD 60,000 - 80,000
Remote AI Quality Evaluator — Graphic/UI/UX Design
Remote AI Quality Evaluator — Graphic/UI/UX Design

workada • Beauharnois

Remote
CAD 80,000 - 95,000
Clear guidelines and training
Performance feedback and opportunities
Mission-driven team
Manufacturing Technician - Woodstock, Ontario
Manufacturing Technician - Woodstock, Ontario

randstad canada • Woodstock

On-site
CAD 45,000 - 65,000
Remote AI Quality Evaluator Intern – Precision & Impact
Remote AI Quality Evaluator Intern – Precision & Impact

raytheon technologies • Longueuil

Remote
CAD 54,000 - 93,000
Clear guidelines and training
Performance feedback and opportunities
Mission-driven team focused on quality
Directeur(trice) logistique et approvisionnement
Directeur(trice) logistique et approvisionnement

brh reseau d experts • Sainte-Marie

Remote
CAD 34,000 - 62,000
Clear guidelines and training
Performance feedback
Growth opportunities
+1
Associé des ventes - Place Laurier #1 (permanent)
Associé des ventes - Place Laurier #1 (permanent)

children s place • Place-Laurier

On-site
CAD 42,000 - 62,000
Clear guidelines and training
Performance feedback and opportunities
Mission-driven team focused on quality
AI Data Labeling QA Specialist — Detail-Driven
AI Data Labeling QA Specialist — Detail-Driven

sitly • Central Ontario

On-site
CAD 26,000 - 30,000
Clear guidelines and training
Performance feedback and opportunities
Mission-driven team focused on quality
Senior HR AI Tools Evaluator & Knowledge Quality Lead
Senior HR AI Tools Evaluator & Knowledge Quality Lead

Obsidian • Toronto

Remote
CAD 90,000 - 120,000
AI Image Pair Rater — Visual Quality & Reasoning Expert
AI Image Pair Rater — Visual Quality & Reasoning Expert

Mercor • Toronto

Remote
CAD 34,000 - 48,000
AI Quality Evaluator — Engineering & Manufacturing (Remote)
AI Quality Evaluator — Engineering & Manufacturing (Remote)

Mercor • Toronto

Remote
CAD 83,000 - 131,000
Remote work
Flexible hours