Remote AI Data Labeling & QA Specialist

Rex.zone; United States; On-site; USD 34,440 - 55,104; Full time

Job summary

Rex.zone is hiring a Remote Data Annotation Specialist to label and evaluate multimodal AI training data for improved evaluation and downstream model behavior. This full-time, fully remote role supports Barcelona-oriented locale data when needed and uses hourly compensation.

Responsibilities include NLP data labeling, RLHF ranking, QA evaluation, and content safety labeling, with collaboration via Rex.zone tools and secure data handling practices.

Qualifications

• Mid-Senior experience in data annotation or labeling.
• Strong rubric adherence and consistent decisions.
• Strong written English for rationale-based grading.
• Familiarity with NLP concepts and LLM evaluation workflows.
• Comfort with web-based annotation tools.
• Experience with QA evaluation or search relevance evaluation.

Responsibilities

• Label and evaluate multi-modal AI training data.
• Rank preferences and provide concise rationales.
• Run QA evaluation on labeled data and resolve conflicts.
• Annotate computer vision data when required (bounding boxes, classifications).
• Label content safety according to policy.
• Track production metrics and support calibration.
• Collaborate asynchronously using Rex.zone tools.

Skills

Data annotation

Data labeling

QA evaluation

Search relevance

English writing

NLP concepts

LLM evaluation

Annotation tools

Spreadsheet workflows

Job description

Rex.zone is hiring a Remote Data Annotation Specialist to label and evaluate multimodal AI training data for improved evaluation and downstream model behavior. This full-time, fully remote role supports Barcelona-oriented locale data when needed and uses hourly compensation.

Responsibilities include NLP data labeling, RLHF ranking, QA evaluation, and content safety labeling, with collaboration via Rex.zone tools and secure data handling practices.