RLHF Evaluation Specialist for AI Training

Rex.zone

Canada

Remote

CAD 56,714 - 94,524

Part time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

A tech company specializing in AI is seeking an AI Trainer based in Canada. The role involves improving large language models through RLHF-style evaluations, prompt evaluation, and data labeling. Candidates should have experience with structured evaluation, strong writing skills, and familiarity with AI evaluation workflows. This position offers an hourly pay range of $30 to $50. Apply by highlighting your relevant experience and compliance with annotation guidelines.

Qualifications

  • Experience with structured evaluation and guideline-driven judgment.
  • Strong writing skills for documenting rationales and edge-case notes.
  • Comfort with data labeling and QA evaluation processes.

Responsibilities

  • Perform RLHF evaluations and write clear rationales.
  • Execute prompt evaluations focusing on instruction-following and safety.
  • Document edge cases and build error taxonomies.

Skills

Structured evaluation
Strong writing
Familiarity with RLHF and LLM evaluation
Data labeling
Multilingual evaluation

Job description

A tech company specializing in AI is seeking an AI Trainer based in Canada. The role involves improving large language models through RLHF-style evaluations, prompt evaluation, and data labeling. Candidates should have experience with structured evaluation, strong writing skills, and familiarity with AI evaluation workflows. This position offers an hourly pay range of $30 to $50. Apply by highlighting your relevant experience and compliance with annotation guidelines.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Trainer Jobs in Canada
AI Trainer Jobs in Canada

Rex.zone • Canada

Remote
CAD 56,714 - 94,524
RLHF Quality Reviewer and Model Evaluator Remote Canada English C1, French C1 CAD 40 to 65 per hour
RLHF Quality Reviewer and Model Evaluator Remote Canada English C1, French C1 CAD 40 to 65 per hour

Corpshore Solutions Corporation • Canada

Hybrid
CAD 34,000 - 55,000
Fully remote across Canada
Flexible weekly hours (20+)
Paid guideline training per programme
+3
Remote Data Labeling Specialist (Canada)
Remote Data Labeling Specialist (Canada)

Rex.zone • Canada

Remote
CAD 48,000 - 68,000
AI Evaluation Specialist (Canada)
AI Evaluation Specialist (Canada)

OpenTrain AI, Inc. • Canada

Remote
CAD 17,000 - 24,000
Remote RLHF Quality Auditor & Model Evaluator
Remote RLHF Quality Auditor & Model Evaluator

Corpshore Solutions Corporation • Canada

Hybrid
CAD 34,000 - 55,000
Fully remote across Canada
Flexible weekly hours (20+)
Paid guideline training per programme
+3
Remote QA Scenario Writer for AI Evaluation - Flexible
Remote QA Scenario Writer for AI Evaluation - Flexible

Mindrift • Canada

Remote
CAD 34,440 - 82,656
Flexible schedule
Work from anywhere
Competitive pay
+1
Remote AI Training Engineer — Code Evaluator & Feedback Pro
Remote AI Training Engineer — Code Evaluator & Feedback Pro

Alignerr Corp. • Calgary

Remote
CAD 83,000 - 165,000
Economics AI Training & Evaluation Specialist
Economics AI Training & Evaluation Specialist

Mindrift • Canada

Remote
CAD 59,833 - 85,217
Competitive pay rates
Flexible, remote work
Senior Software Engineer - AI Data
Senior Software Engineer - AI Data

OpenTrain AI, Inc. • Canada

Remote
CAD 136,000 - 194,000
Flexible scheduling
Remote work
Competitive hourly pay
Remote AI Quality Evaluator & Data Analytics Manager
Remote AI Quality Evaluator & Data Analytics Manager

Brock University • St. Catharines

Remote
CAD 74,000 - 119,000
Clear guidelines
Growth opportunities
Mission-driven team