AI Trainer Jobs in Canada

Rex.zone

Canada

Remote

CAD 56,714 - 94,524

Part time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

A tech company specializing in AI is seeking an AI Trainer based in Canada. The role involves improving large language models through RLHF-style evaluations, prompt evaluation, and data labeling. Candidates should have experience with structured evaluation, strong writing skills, and familiarity with AI evaluation workflows. This position offers an hourly pay range of $30 to $50. Apply by highlighting your relevant experience and compliance with annotation guidelines.

Qualifications

  • Experience with structured evaluation and guideline-driven judgment.
  • Strong writing skills for documenting rationales and edge-case notes.
  • Comfort with data labeling and QA evaluation processes.

Responsibilities

  • Perform RLHF evaluations and write clear rationales.
  • Execute prompt evaluations focusing on instruction-following and safety.
  • Document edge cases and build error taxonomies.

Skills

Structured evaluation
Strong writing
Familiarity with RLHF and LLM evaluation
Data labeling
Multilingual evaluation

Job description

About The Role

AI Trainer jobs in Canada focus on improving large language models through RLHF-style evaluations, prompt evaluation, data labeling, and QA evaluation across real AI/ML training pipelines. You will follow detailed annotation guidelines, verify training data quality, and provide structured feedback that improves helpfulness, correctness, and safety.

What You’ll Do
  • Perform RLHF evaluations (pairwise ranking, rubric-based scoring) and write clear rationales
  • Execute prompt evaluation for instruction-following, factuality, and safety
  • Label and validate datasets for NLP and content safety labeling
  • Run QA evaluation checks (consistency, agreement, systematic error discovery)
  • Document edge cases and build error taxonomies to drive model performance improvement
  • Collaborate on rubrics, gold sets, calibration, and regression testing for model updates
Skills And Qualifications
  • Experience with structured evaluation and guideline-driven judgment
  • Strong writing and documentation for rationales and edge-case notes
  • Familiarity with RLHF, LLM evaluation, and prompt evaluation workflows
  • Comfort with data labeling, QA evaluation, and training data quality processes
  • Bonus: multilingual evaluation, NER/classification tasks, or multimodal evaluation
How To Apply

Browse roles on Rex.zone and apply with a resume highlighting RLHF, data labeling, QA evaluation, annotation guidelines compliance, and examples of model evaluation feedback.

Hourly base pay range: $30–$50.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

RLHF Evaluation Specialist for AI Training
RLHF Evaluation Specialist for AI Training

Rex.zone • Canada

Remote
CAD 56,714 - 94,524
Remote Data Labeling Specialist (Canada)
Remote Data Labeling Specialist (Canada)

Rex.zone • Canada

Remote
CAD 48,000 - 68,000
AI Evaluation Specialist (Canada)
AI Evaluation Specialist (Canada)

OpenTrain AI, Inc. • Canada

Remote
CAD 17,000 - 24,000
AI Voice Evaluation Specialist
AI Voice Evaluation Specialist

Jobgether • Canada

Remote
CAD 28,000 - 34,000
Remote work within Canada
40-hour work week
3-month contract
RLHF Quality Reviewer and Model Evaluator Remote Canada English C1, French C1 CAD 40 to 65 per hour
RLHF Quality Reviewer and Model Evaluator Remote Canada English C1, French C1 CAD 40 to 65 per hour

Corpshore Solutions Corporation • Canada

Hybrid
CAD 34,000 - 55,000
Fully remote across Canada
Flexible weekly hours (20+)
Paid guideline training per programme
+3
AI Trainer - Freelance Annotator (Italian)
AI Trainer - Freelance Annotator (Italian)

Toloka Annotators • Canada

Remote
CAD 20,664 - 24,796
Up to $18/hour based on skills
Flexible part-time remote work
Experience on advanced AI projects
AI Data Annotation Specialist (Freelance in Canada)
AI Data Annotation Specialist (Freelance in Canada)

TELUS Digital • Quebec

Remote
CAD 11,389 - 34,169
Remote Data Labeling Specialist for AI Training QA
Remote Data Labeling Specialist for AI Training QA

Rex.zone • Canada

Remote
CAD 48,000 - 68,000
AI Trainer - Advanced Japanese Fluency (Fully Remote- Canada)
AI Trainer - Advanced Japanese Fluency (Fully Remote- Canada)

Prolific • Toronto

Remote
CAD 41,328
Competitive pay rates
Flexible hours
Work from home
AI Trainer - Advanced Arabic Fluency (Canada)
AI Trainer - Advanced Arabic Fluency (Canada)

Prolific • Toronto

Remote
CAD 47,315 - 67,388