Remote Data Annotation Specialist: Generalist (Part-Time)

Avenue.io Inc.; Toronto, Montreal; Remote; CAD 19,000 - 24,000; Part time

Job summary

Cohere is seeking a part-time Data Annotation Specialist, an independent contractor role based in Canada. You will review and annotate English-language data across text, image, and structured formats, applying detailed guidelines and ensuring data integrity. This position is remote, BYOD, with 16 hours per week at CAD 30/hour.

You will evaluate model outputs, stress-test models, and help design rubrics and datasets. Strong judgment, attention to detail, and English proficiency are essential.

Qualifications

• 1+ years in AI data annotation or related analytical role.
• Ability to apply detailed guidelines to ambiguous content with context.
• Comfort with remote, asynchronous work in a global team.
• Experience with JSON/CSV/Markdown/XML/YAML formats.

Responsibilities

• Evaluate and rank model outputs and justify judgments.
• Stress-test and break models and document failure modes.
• Create datasets with prompts, responses, and exemplars.
• Build and apply rubrics and taxonomies for annotations.
• Annotate and correct multimodal data (text, image, structured data).
• Calibrate and maintain consistency across annotations.
• Adapt to evolving tasks and experimental needs.
• Report on model performance with clear feedback.

Skills

AI data annotation

LLM evaluation

Analytical mindset

Written English

Tools

Annotation platforms

Job description

Cohere is seeking a part-time Data Annotation Specialist, an independent contractor role based in Canada. You will review and annotate English-language data across text, image, and structured formats, applying detailed guidelines and ensuring data integrity. This position is remote, BYOD, with 16 hours per week at CAD 30/hour.

You will evaluate model outputs, stress-test models, and help design rubrics and datasets. Strong judgment, attention to detail, and English proficiency are essential.