Remote Data Labeling Specialist (India)

Rex.zone; United States; On-site; USD 41,328 - 68,880; Full time

Job summary

A tech company is looking for a Remote Data Labeling Specialist to create and validate labeled training data for AI/ML systems. In this role, you will label and review diverse data types and perform evaluations for language model assessments. The position requires mid-to-senior level experience in data annotation, strong English reading skills, and familiarity with annotation tools. Competitive hourly compensation ranges from $30 to $50, depending on skills and program needs.

Qualifications

• Mid-to-senior experience in data labeling/data annotation with measurable QA outcomes.
• Comfort with annotation tools, task queues, and remote QA workflows.
• Ability to apply consistent labeling decisions and document edge cases clearly.

Responsibilities

• Label and review text, image, and multimodal data for AI/ML use cases.
• Perform RLHF-style preference ranking and prompt evaluation for large language model evaluation.
• Execute QA evaluation checks, resolve disagreements, and reduce annotation variance.

Skills

Data labeling

Annotation guidelines compliance

Remote QA workflows

Strong English reading comprehension

Job description

Remote Data Labeling Jobs in India

Rex.zone is hiring a Remote Data Labeling Specialist to create and validate labeled training data for AI/ML systems, including LLM evaluation workflows. You will follow detailed annotation guidelines, document edge cases, and collaborate with QA reviewers to improve training data quality and downstream model performance.

What You Will Do

• Label and review text, image, and multimodal data for AI/ML use cases
• Perform RLHF-style preference ranking and prompt evaluation for large language model evaluation
• Execute QA evaluation checks, resolve disagreements, and reduce annotation variance
• Maintain annotation guidelines compliance and escalate ambiguous policy edge cases
• Contribute to training data quality metrics (accuracy vs. gold sets, audits, inter-annotator agreement)
• Collaborate asynchronously with project leads across AI labs, tech startups, BPO teams, and annotation vendors

Key Workflows

• NLP: classification, intent, named entity recognition, entity linking, taxonomy tagging
• Computer Vision: bounding boxes, polygons, keypoints, segmentation masks, OCR tagging
• Content Safety: policy-based labeling, moderation categories, sensitive attributes handling
• LLM Evaluation: response grading, hallucination checks, factuality review, safety alignment, RLHF ranking
• Quality Systems: gold-set calibration, audit sampling, error taxonomy

Requirements

• Mid-to-senior experience in data labeling/data annotation with measurable QA outcomes
• Strong English reading comprehension and careful instruction-following for rubric-based evaluation
• Comfort with annotation tools, task queues, and remote QA workflows
• Ability to apply consistent labeling decisions and document edge cases clearly

Compensation

Competitive hourly rate: $30–$50 per hour (based on skills and program needs).