Remote AI Data Labeling & QA Specialist

Rex.zone; San Diego (CA); On-site; USD 20,664 - 30,307; Full time

Job summary

Rex.zone is seeking a Remote Data Labeling Specialist to support training-data creation for AI systems. You will label text, images, audio, and video for LLM evaluation, RLHF workflows, and computer vision annotation.

This fully remote role is open to candidates in the United States, including San Diego, with clear quality and throughput targets. You will work with secure web-based tools and collaborate asynchronously with remote teams.

Qualifications

• Professional experience in data labeling/data annotation with strong guideline compliance.
• Ability to justify decisions with evidence and self-audit for consistency and accuracy.
• Strong written English and ability to collaborate asynchronously with remote teams.
• Familiarity with RLHF, QA evaluation, and prompt evaluation in LLM training pipelines.

Responsibilities

• Create and validate labeled datasets for model training and evaluation.
• Perform RLHF preference ranking (compare responses, select best per guidelines, write brief rationales).
• Complete prompt-response evaluation and rubric-based QA evaluation.
• Annotate NLP datasets (e.g., named entity recognition, intent, sentiment, toxicity).
• Perform computer vision annotation (bounding boxes, polygons, keypoints, segmentation masks, classification).
• Conduct content safety labeling (policy categories, severity, refusal correctness).
• Support training data quality via sampling, adjudication, error analysis, and edge-case handling.

Skills

Guideline compliance

Strong written English

Remote collaboration

Evidence-based decision making

Job description

Rex.zone is seeking a Remote Data Labeling Specialist to support training-data creation for AI systems. You will label text, images, audio, and video for LLM evaluation, RLHF workflows, and computer vision annotation.

This fully remote role is open to candidates in the United States, including San Diego, with clear quality and throughput targets. You will work with secure web-based tools and collaborate asynchronously with remote teams.