Remote AI Data Labeling Specialist for RLHF & QA

Rex.zone; United States; On-site; USD 55,000 - 78,000; Full time

Job summary

Rex.zone is seeking a Remote Data Labeling Specialist to label and evaluate multi-modal AI training data (text, images, and conversations) to improve model quality. You will follow rubrics, maintain guidelines compliance, and support production systems with high-precision annotations.

In this fully remote, full-time role within the United States, you will perform labeling for LLM pipelines, RLHF tasks, and content safety tagging, while documenting edge cases and proposing taxonomy updates based

Qualifications

• Experience with production data labeling or QA evaluation workflows.
• Ability to work with detailed taxonomies, rubrics, and policy language.
• Maintain throughput while protecting data quality.
• Clear asynchronous communication in a fully remote environment.

Responsibilities

• Label and annotate multimodal data for model training.
• Perform RLHF tasks including preference comparisons and rubric scoring.
• Evaluate LLM prompts for helpfulness, factuality, grounding, relevance, and instruction-following.
• Apply named entity recognition and span labeling per rubrics.
• Support computer vision annotation (boxes, polygons, keypoints) as needed.
• Run QA audits and inter-annotator agreement checks.
• Document edge cases and propose taxonomy updates with evidence.

Skills

Data labeling

QA workflows

Rubrics & taxonomies

Remote communication

Job description

Rex.zone is seeking a Remote Data Labeling Specialist to label and evaluate multi-modal AI training data (text, images, and conversations) to improve model quality. You will follow rubrics, maintain guidelines compliance, and support production systems with high-precision annotations.

In this fully remote, full-time role within the United States, you will perform labeling for LLM pipelines, RLHF tasks, and content safety tagging, while documenting edge cases and proposing taxonomy updates based