Senior Remote Data Labeling & Evaluation Specialist

Rex.zone; Boston (MA); Remote; USD 41,000 - 69,000; Full time

Job summary

Rex.zone is hiring for a full-time, fully remote data labeling role based in the United States. You will label text, images, audio, and video, following strict guidelines to improve AI training data quality for LLM pipelines.

Work fully remotely from the US with an hourly pay range and strong emphasis on QA, RLHF tasks, and consistency checks. This position requires independent work in a remote setting while meeting quality and throughput goals.

Qualifications

• Mid-Senior experience delivering accurate annotations at production scale.
• Strong attention to detail and ability to follow strict taxonomies and policy requirements.
• Comfort working independently in a remote, full-time setting while meeting quality and throughput goals.
• Understanding of how labeling decisions impact model performance and downstream metrics.

Responsibilities

• Annotate text, image, audio, and video samples for AI/ML datasets.
• Perform QA evaluations, self-audits, and consistency checks.
• Complete RLHF tasks such as ranking and rubric-based scoring with concise rationales.
• Run prompt evaluation for usefulness, harmlessness, and factuality.
• Label NER and relations for NLP tasks.
• Support computer vision annotation (bounding boxes, polygons) where applicable.
• Apply content safety labeling policies and elevate edge cases with examples.
• Document decision rules to resolve ambiguity and improve batch consistency.

Skills

Annotation accuracy

Attention to detail

Remote work

Quality assurance

Job description

Rex.zone is hiring for a full-time, fully remote data labeling role based in the United States. You will label text, images, audio, and video, following strict guidelines to improve AI training data quality for LLM pipelines.

Work fully remotely from the US with an hourly pay range and strong emphasis on QA, RLHF tasks, and consistency checks. This position requires independent work in a remote setting while meeting quality and throughput goals.