Turn this role into an interview — a resume and cover letter built around what this employer wants.
Workada is seeking a remote, full-time evaluator to assess AI outputs—text, images, video, and documents—against strict criteria and provide well-reasoned justifications. You will help improve system accuracy and reliability by documenting findings and following detailed guidelines.
The role emphasizes strong written communication, critical thinking, and adherence to specific evaluation criteria to ensure high-quality feedback for model improvements.
Remote
Full-time
CA$45.00 hourly
At Workada, we're not just labeling data, we're helping improve the technology people use every day. Our work creates the examples and feedback that make advanced systems more accurate, consistent, and useful.
Evaluate outputs from AI models, text, images, video, and documents against detailed criteria. Assess quality, spot errors and inconsistencies, and write clear, well-reasoned justifications for your judgments. Every evaluation you complete helps these systems perform better in the real world.
People who write clearly, think critically, and can back up a judgment call with a clear explanation. This role suits people who've done work built around precise written evaluation, UI/UX design, graphic design, photography, video production, editorial or research work, or writing technical specs and requirements. - Strong readers and writers with sound judgment - Comfortable evaluating creative or technical work against a set of criteria - Takes quality seriously and catches what others miss - Can follow detailed written guidelines independently