AI Jobs in India — Remote AI Data Annotation Specialist

Rex.zone; United States; On-site; USD 41,328 - 68,880; Full time

Job summary

A technology firm specializing in data annotation is seeking a remote AI Data Annotation Specialist. The role involves executing high-quality data labeling and annotation for NLP and computer vision datasets. Ideal candidates will have mid-senior experience, strong written English skills, and familiarity with LLM evaluation concepts. Compensation ranges from $30 to $50 per hour, depending on complexity, and the work environment requires strong QA practices and asynchronous communication.

Qualifications

• Mid-Senior experience delivering high-precision labeling/evaluation work.
• Strong written English and ability to follow complex rubrics.
• Familiarity with LLM evaluation and RLHF concepts.

Responsibilities

• Execute data labeling and annotation for NLP and computer vision datasets.
• Perform RLHF-style preference comparisons and graded rewards.
• Document edge cases and contribute to annotation guidelines updates.

Skills

High-precision labeling/evaluation work

Strong written English

Familiarity with LLM evaluation

Strong QA mindset

Asynchronous communication

Job description

Overview

About The Role Rex.zone is hiring remote, full-time AI Data Annotation Specialists to support LLM training pipelines through high-quality data labeling, RLHF evaluation, prompt evaluation, and QA evaluation. You will work on multimodal datasets (text and image) and deliver rubric-aligned judgments that improve training data quality and model performance.

Responsibilities

• Execute data labeling and data annotation for NLP and computer vision datasets
• Perform RLHF-style preference comparisons and graded reward-model judgments
• Run prompt evaluation and response grading using detailed rubrics
• Complete QA evaluation audits, guideline compliance checks, and rework cycles
• Apply named entity recognition (NER), taxonomy tagging, and text classification
• Conduct content safety labeling (policy, harm, hate, self-harm, sexual content) with escalation workflows
• Document edge cases and contribute to annotation guidelines updates
• Report throughput, agreement rates, and error categories to improve production quality

Qualifications

• Mid-Senior experience delivering high-precision labeling/evaluation work
• Strong written English and ability to follow complex rubrics
• Familiarity with LLM evaluation, RLHF concepts, and prompt evaluation methods
• Strong QA mindset: sampling, audits, disagreement analysis, and root-cause analysis
• Comfort working remotely with asynchronous communication and versioned guidelines

Compensation

$30–$50 per hour (base salary, hourly). Final compensation depends on scope and evaluation complexity.

How To Apply

Apply via Rex.zone and share relevant labeling, evaluation, and QA experience.