Remote AI Content Evaluator & Prompt Specialist

Crossing Hurdles

Canada

Remote

CAD 25,000 - 39,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Crossing Hurdles is seeking an evaluator to assess AI tools under standardized conditions and annotate model responses. You will write and refine prompts to probe capabilities and edge cases, then verify consistency across evaluations and ratings.

This role emphasizes collaboration, adherence to guidelines, and participation in quality reviews to improve training standards. The ideal candidate will have prior experience with AI model training or data labeling projects, strong communication, and

Qualifications

  • Exceptional attention to detail in evaluating AI-generated content.
  • Strong written and verbal communication for collaboration.
  • Experience with AI model training or data labeling projects.
  • Familiarity with AI products and prompt engineering.
  • Experience writing evaluation rubrics or reviewing AI responses for accuracy.

Responsibilities

  • Evaluate the performance of AI tools under standardized conditions.
  • Apply grading guidelines to evaluate and annotate model responses.
  • Write and refine prompts that probe model capabilities and edge cases.
  • Verify consistency and accuracy across evaluations and ratings.
  • Utilize training tools to submit evaluation datasets that meet standards.
  • Collaborate with team members to refine guidelines and ensure consistency.
  • Participate in quality reviews, incorporating feedback for training standards.

Skills

Attention to detail
Communication skills
Time management
Analytical mindset
AI data labeling
Prompt engineering
Evaluation rubrics

Job description

Crossing Hurdles is seeking an evaluator to assess AI tools under standardized conditions and annotate model responses. You will write and refine prompts to probe capabilities and edge cases, then verify consistency across evaluations and ratings.

This role emphasizes collaboration, adherence to guidelines, and participation in quality reviews to improve training standards. The ideal candidate will have prior experience with AI model training or data labeling projects, strong communication, and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Content Quality Evaluator
AI Content Quality Evaluator

Crossing Hurdles • Canada

On-site
CAD 60,000 - 80,000
Content Reviewer | $36/hr Remote
Content Reviewer | $36/hr Remote

Crossing Hurdles • Canada

Remote
CAD 25,000 - 39,000
English Language Expert
English Language Expert

SME Careers • Calgary

Remote
CAD 34,000 - 62,000
Remote AI Data Reviewer UI Analysis & Feedback (Contract)
Remote AI Data Reviewer UI Analysis & Feedback (Contract)

Crossing Hurdles • Canada

Remote
CAD 34,000 - 55,000
Remote AI Content Writer & Evaluator
Remote AI Content Writer & Evaluator

Outlier • Halifax

Hybrid
CAD 24,000 - 34,000
Remote work
Flexible schedule
Weekly payouts
Remote AI Content Evaluator - Part-Time, Flexible Hours
Remote AI Content Evaluator - Part-Time, Flexible Hours

Work Vista • Canada

Remote
CAD 28,474 - 34,169
Flexible work schedule
100% remote work
Remote AI Writing & Evaluation Consultant
Remote AI Writing & Evaluation Consultant

Outlier • Longueuil

Remote
CAD 24,000 - 34,000
Base rate up to $15/hr USD
Bonuses available
Freelance/1099 contract
+3
AI Evaluation Specialist | Remote
AI Evaluation Specialist | Remote

Crossing Hurdles • Canada

Remote
CAD 40,000 - 60,000
Content Evaluator | $70/hr Remote
Content Evaluator | $70/hr Remote

Crossing Hurdles • Canada

On-site
CAD 60,000 - 80,000
Remote AI Writing & Evaluation Specialist
Remote AI Writing & Evaluation Specialist

Outlier • Vancouver

Remote
CAD 24,000 - 34,000