AI Quality Evaluator — Remote, Full-Time

Saskdocs; Saskatoon; Remote; CAD 42,000 - 64,000; Full time

Benefits offered by this job

Guidance & training

Feedback & growth

Mission-driven team

Job summary

Workada is seeking a detail-oriented evaluator to improve AI systems by reviewing outputs from text, images, video, and documents against clear criteria, identifying gaps, and writing clear, well-reasoned judgments.

In a remote, full-time role, you’ll follow documented guidelines, maintain consistency, and help our systems become more accurate and reliable, ultimately supporting better user experiences across real-world applications.

Qualifications

• Strong readers and writers with sound judgment.
• Comfortable evaluating creative or technical work against criteria.
• Can follow detailed written guidelines independently.

Responsibilities

• Evaluate outputs from AI models, text, images, video, and documents against detailed criteria.
• Assess quality, spot errors and inconsistencies, and write clear, well-reasoned justifications for judgments.
• Each evaluation helps systems perform better in the real world.

Skills

Strong readers and writers

Sound judgment

Independent

Critical thinking

Job description

Workada is seeking a detail-oriented evaluator to improve AI systems by reviewing outputs from text, images, video, and documents against clear criteria, identifying gaps, and writing clear, well-reasoned judgments.

In a remote, full-time role, you’ll follow documented guidelines, maintain consistency, and help our systems become more accurate and reliable, ultimately supporting better user experiences across real-world applications.