Online Generalist Jobs in Canada

Rex.zone; Canada; Remote; CAD 41,328 - 68,880; Full time

Job summary

A tech company is seeking full-time remote Online Generalists in Canada to support AI/ML data operations. Responsibilities include data labeling across NLP tasks, conducting evaluations, and ensuring content safety through guideline adherence. Candidates benefit from a strong attention to detail and comprehension skills. The position offers competitive compensation ranging from $30 to $50 per hour based on experience and performance.

Qualifications

• Located in Canada, able to work full-time remotely.
• Strong reading comprehension and attention to detail.
• Comfortable with detailed annotation guidelines.

Responsibilities

• Perform data labeling for NLP tasks and LLM evaluation workflows.
• Create preference data for RLHF by ranking model outputs.
• Conduct prompt evaluation and response scoring.
• Execute QA evaluation and consistency checks.
• Handle content safety labeling following guidelines.
• Complete computer vision annotations as needed.

Skills

Attention to detail

Reading comprehension

Data labeling

QA evaluation

RLHF

Job description

Rex.zone is hiring full-time remote Online Generalists in Canada to support AI/ML data operations that power large language model training pipelines. You will complete online tasks such as data labeling, RLHF preference ranking, prompt evaluation, QA evaluation, and content safety labeling across NLP and computer vision datasets.

Responsibilities

• Perform data labeling for NLP tasks (classification, summarization, named entity recognition) and LLM evaluation workflows
• Create preference data for RLHF by ranking/scoring model outputs and writing clear rationales
• Conduct prompt evaluation and response scoring using web-based evaluation interfaces
• Execute QA evaluation, adjudication, and consistency checks to improve training data quality
• Handle content safety labeling using policy-based decisions and detailed guidelines
• Complete computer vision annotation including image tagging, bounding boxes, and segmentation as needed
• Document edge cases, follow versioned guidelines, and escalate ambiguity appropriately

Qualifications

• Based in Canada and able to work full-time remotely
• Strong reading comprehension, attention to detail, and consistent decision-making
• Comfortable following detailed annotation guidelines and meeting quality standards
• Experience in data labeling, QA evaluation, RLHF, or LLM evaluation is preferred but not required

Quality Standards

• Maintain high guideline adherence, low error rates, and responsiveness to feedback
• Support inter-annotator agreement and training data quality audits through careful self-checks

Compensation

• Competitive hourly rate: $30–$50 per hour