Senior Data Labeling Specialist - Remote, US-based

Rex.zone; United States; On-site; USD 41,328 - 68,880; Full time

Job summary

Rex.zone is seeking a Senior Data Labeling Specialist to drive training data quality for AI systems. This remote US-based role supports London-aligned projects while remaining Remote for employment details.

You will lead NLP labeling, QA, and RLHF tasks, build guidelines, and help reduce label noise across multiple domains. Precision and calibration are essential, with strong problem-solving and edge-case handling.

Qualifications

• Senior data labeling experience with high accuracy and calibration.
• Comfort with structured evaluation logic, audits, and gold data workflows.
• Experience with RLHF-style labeling, prompt evaluation, and QA evaluation.
• Familiarity with large language model evaluation criteria and reducing label noise.

Responsibilities

• Perform and lead senior data labeling work across NLP and content safety labeling workflows.
• Create, refine, and enforce annotation guidelines compliance and labeling rubrics.
• Complete RLHF preference rankings and preference data creation.
• Run QA evaluation, audits, and adjudication on disputed / edge-case examples.
• Execute named entity recognition and text classification tasks with high precision.
• Support computer vision annotation (e.g., bounding boxes/polygons/keypoints) when needed.
• Document edge cases, elevate taxonomy gaps, and improve inter-annotator agreement.

Skills

Senior data labeling

Structured evaluation logic

RLHF labeling

LLM evaluation

Job description

Rex.zone is seeking a Senior Data Labeling Specialist to drive training data quality for AI systems. This remote US-based role supports London-aligned projects while remaining Remote for employment details.

You will lead NLP labeling, QA, and RLHF tasks, build guidelines, and help reduce label noise across multiple domains. Precision and calibration are essential, with strong problem-solving and edge-case handling.