Content Reviewer | $36/hr Remote

Crossing Hurdles

Canada

Remote

CAD 25,000 - 39,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Crossing Hurdles is seeking an evaluator to assess AI tools under standardized conditions and annotate model responses. You will write and refine prompts to probe capabilities and edge cases, then verify consistency across evaluations and ratings.

This role emphasizes collaboration, adherence to guidelines, and participation in quality reviews to improve training standards. The ideal candidate will have prior experience with AI model training or data labeling projects, strong communication, and

Qualifications

  • Exceptional attention to detail in evaluating AI-generated content.
  • Strong written and verbal communication for collaboration.
  • Experience with AI model training or data labeling projects.
  • Familiarity with AI products and prompt engineering.
  • Experience writing evaluation rubrics or reviewing AI responses for accuracy.

Responsibilities

  • Evaluate the performance of AI tools under standardized conditions.
  • Apply grading guidelines to evaluate and annotate model responses.
  • Write and refine prompts that probe model capabilities and edge cases.
  • Verify consistency and accuracy across evaluations and ratings.
  • Utilize training tools to submit evaluation datasets that meet standards.
  • Collaborate with team members to refine guidelines and ensure consistency.
  • Participate in quality reviews, incorporating feedback for training standards.

Skills

Attention to detail
Communication skills
Time management
Analytical mindset
AI data labeling
Prompt engineering
Evaluation rubrics

Job description

  • Evaluate the performance of AI tools under standardized conditions
  • Apply grading guidelines to evaluate and annotate model responses
  • Write and refine prompts that probe model capabilities and edge cases
  • Verify consistency and accuracy across evaluations and ratings
  • Utilize training tools to submit evaluation datasets that meet standards
  • Collaborate with team members to refine guidelines and ensure consistency
  • Participate in quality reviews, incorporating feedback for training standards
Requirements
  • Exceptional attention to detail in evaluating AI-generated content
  • Strong written and verbal communication skills for effective collaboration
  • Demonstrated time management abilities for remote project participation
  • Analytical mindset with a proactive approach to evaluation challenges
  • Proven experience with AI model training or data labeling projects
  • Familiarity with AI products and tools, including prompt engineering
  • Experience writing evaluation rubrics or reviewing AI responses for accuracy
Application Process (Takes 20 Min)
  • Easy Apply on LinkedIn
  • Participate in resume evaluation & interview stage
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Content Evaluator | $70/hr Remote
Content Evaluator | $70/hr Remote

Crossing Hurdles • Canada

On-site
CAD 60,000 - 80,000
Content Evaluator (Remote)
Content Evaluator (Remote)

Work Vista • Canada

Remote
CAD 28,474 - 34,169
Flexible work schedule
100% remote work
AI Data Reviewer | $40/hr Remote
AI Data Reviewer | $40/hr Remote

Crossing Hurdles • Canada

Remote
CAD 34,440 - 55,104
AI Evaluation Specialist | Remote
AI Evaluation Specialist | Remote

Crossing Hurdles • Canada

Remote
CAD 40,000 - 60,000
English Language Expert
English Language Expert

SME Careers • Calgary

Remote
CAD 34,000 - 62,000
Senior Software Engineer - AI Data
Senior Software Engineer - AI Data

OpenTrain AI, Inc. • Canada

Remote
CAD 136,000 - 194,000
Flexible scheduling
Remote work
Competitive hourly pay
AI Evaluation Specialist (Canada)
AI Evaluation Specialist (Canada)

OpenTrain AI, Inc. • Canada

Remote
CAD 17,000 - 24,000
Remote AI Content Evaluator & Prompt Specialist
Remote AI Content Evaluator & Prompt Specialist

Crossing Hurdles • Canada

Remote
CAD 25,000 - 39,000
Managing Editor (Digital Content) | $61/hr Remote
Managing Editor (Digital Content) | $61/hr Remote

Crossing Hurdles • Canada

Remote
Confidential
Content Editor
Content Editor

DataAnnotation • Montreal

Remote
CAD 37,866 - 56,800