Remote Data Labeling Jobs in Ottawa

Rex.zone; Ottawa; Remote; CAD 59,000 - 98,000; Full time

Job summary

Rex.zone is seeking remote data labeling specialists to support AI/ML training workflows. You will label and review diverse data types, follow strict guidelines, and contribute to RLHF and QA evaluations to improve model performance.

The role emphasizes strong written reasoning, asynchronous collaboration, and adherence to audit-driven processes, with compensation around the stated hourly range.

Qualifications

• Mid-Senior experience with data labeling or data annotation in AI/ML production settings.
• Experience with LLM evaluation workflows (RLHF, prompt evaluation, or QA evaluation).
• Strong written communication and structured reasoning for labeling rationale and dispute resolution.
• Comfort working remotely with asynchronous collaboration, quality targets, and audit-driven processes.

Responsibilities

• Label and review text, image, audio, or video data using project-specific annotation tools and taxonomies.
• Follow annotation guidelines compliance requirements and document edge cases for consistent decision-making.
• Complete RLHF tasks such as preference ranking, pairwise comparisons, and rubric-based scoring for LLM outputs.
• Perform prompt evaluation and response grading for helpfulness, correctness, and safety.
• Execute QA evaluation by auditing samples, measuring inter-annotator agreement, and escalating ambiguity.
• Apply named entity recognition (NER) labels and structured extraction schemas for NLP datasets.
• Support computer vision annotation (bounding boxes, segmentation masks, keypoints) when assigned.
• Contribute to content safety labeling for policy categories (hate, harassment, self-harm, sexual content) as required.
• Provide feedback to improve guidelines, reduce ambiguity, and increase throughput without sacrificing quality.

Skills

Data labeling

Data annotation

LLM evaluation workflows

Written communication

Asynchronous collaboration

QA/documentation

Tools

Annotation tools

Job description

About Rex.zone

Rex.zone is hiring for remote data labeling jobs aligned to Ottawa job seekers supporting AI/ML training workflows. You will create and evaluate high-quality training data for large language models and computer vision systems, improving training data quality and model performance.

Rex.zone is hiring for remote data labeling jobs aligned to Ottawa job seekers supporting AI/ML training workflows. You will create and evaluate high-quality training data for large language models and computer vision systems, improving training data quality and model performance.

What You Will Do

• Label and review text, image, audio, or video data using project-specific annotation tools and taxonomies.
• Follow annotation guidelines compliance requirements and document edge cases for consistent decision-making.
• Complete RLHF tasks such as preference ranking, pairwise comparisons, and rubric-based scoring for LLM outputs.
• Perform prompt evaluation and response grading for helpfulness, correctness, and safety.
• Execute QA evaluation by auditing samples, measuring inter-annotator agreement, and escalating ambiguity.
• Apply named entity recognition (NER) labels and structured extraction schemas for NLP datasets.
• Support computer vision annotation (bounding boxes, segmentation masks, keypoints) when assigned.
• Contribute to content safety labeling for policy categories (hate, harassment, self-harm, sexual content) as required.
• Provide feedback to improve guidelines, reduce ambiguity, and increase throughput without sacrificing quality.

Required Qualifications

• Mid-Senior experience with data labeling or data annotation in AI/ML production settings.
• Experience with LLM evaluation workflows (RLHF, prompt evaluation, or QA evaluation).
• Strong written communication and structured reasoning for labeling rationale and dispute resolution.
• Comfort working remotely with asynchronous collaboration, quality targets, and audit-driven processes.

Compensation

Hourly base pay range: $30–$50/hr (USD).