Remote AI Data Labeling & Evaluation Specialist

Rex.zone; Raleigh (NC); Remote; USD 41,328 - 68,880; Full time

Job summary

Rex.zone is seeking a Remote Data Labeling Specialist to work from anywhere within the United States. You will label and review multi-modal data for AI training, including text, images, audio, and video, and perform NLP tasks such as classification and named entity recognition.

The role also covers computer vision annotation with bounding boxes and segmentation, content safety labeling, and RLHF-style evaluation tasks.

Qualifications

• 2+ years in data labeling, data annotation, QA evaluation, or AI data operations.
• Strong attention to detail and proven annotation guidelines compliance.
• Comfortable making consistent decisions across edge cases (mid-senior expectations).
• Experience with RLHF-style ranking, LLM evaluation, or prompt evaluation preferred.

Responsibilities

• Deliver accurate labels aligned to annotation guidelines and complex rubrics.
• Execute QA evaluation workflows (spot checks, gold set validation, sampling audits, inter-annotator agreement).
• Document edge cases, rationales, and disagreement resolution to improve training data quality.
• Maintain throughput targets while preserving precision and consistency across batches.
• Protect data privacy and follow content and safety policies.

Skills

Attention to detail

Data labeling

QA evaluation

RLHF ranking

Job description

Rex.zone is seeking a Remote Data Labeling Specialist to work from anywhere within the United States. You will label and review multi-modal data for AI training, including text, images, audio, and video, and perform NLP tasks such as classification and named entity recognition.

The role also covers computer vision annotation with bounding boxes and segmentation, content safety labeling, and RLHF-style evaluation tasks.