Remote Data Annotator Jobs in Portland

Rex.zone; Portland (OR); Remote; USD 25,000 - 41,000; Full time

Job summary

Rex.zone is hiring a remote data annotator to support AI/ML training pipelines. You will create high-signal labeled data for NLP, computer vision, and content safety, applying guidelines consistently from anywhere with online tools.

The role emphasizes careful decision‑making, strong written communication for remote collaboration, and participation in QA, audits, and calibration sessions, with work possible from Portland, Oregon.

Qualifications

• Experience with structured labeling workflows and careful, consistent decision‑making.
• Comfort working in web‑based annotation tools and tracking tasks.
• Strong written communication for remote collaboration and escalation of ambiguous cases.

Responsibilities

• Annotate text for NLP tasks (classification, named entity recognition, summarization evaluation)
• Perform prompt evaluation and LLM response scoring using rubrics
• Complete RLHF preference ranking and comparison tasks
• Label images for computer vision annotation (bounding boxes, polygons, segmentation)
• Document edge cases and provide clear notes to improve annotation guidelines
• Run QA checks, support audits, and participate in calibration sessions

Skills

Structured labeling workflows

Careful, consistent decision making

Strong written communication

Tools

Annotation tools

Task tracking tools

Job description

About The Role

Rex.zone is hiring for remote data annotator work supporting modern AI/ML training pipelines. You will create high-signal labeled datasets used in NLP, computer vision, and content safety systems, and contribute directly to model reliability through consistent guideline application and QA evaluation.

What You’ll Do

• Annotate text for NLP tasks (classification, named entity recognition, summarization evaluation)
• Perform prompt evaluation and LLM response scoring using rubrics
• Complete RLHF preference ranking and comparison tasks
• Label images for computer vision annotation (bounding boxes, polygons, segmentation)
• Document edge cases and provide clear notes to improve annotation guidelines
• Run QA checks, support audits, and participate in calibration sessions

How Quality Is Measured

• Guidelines compliance and accuracy on gold tasks
• Inter-annotator agreement and audit outcomes
• Low rework rates and clear edge-case documentation

Required Qualifications

• Experience with structured labeling workflows and careful, consistent decision‑making
• Comfort working in web‑based annotation tools and tracking tasks
• Strong written communication for remote collaboration and escalation of ambiguous cases

Preferred Qualifications

• Experience with RLHF, content safety labeling, or policy enforcement labeling
• Familiarity with NLP evaluation tasks (NER, instruction‑following, retrieval relevance)
• Exposure to computer vision annotation and dataset QA concepts (gold sets, sampling, agreement)

Workplace

This is a FULL_TIME role that is explicitly Remote and can be performed from Portland, Oregon using online tools and remote team communication.