Remote Data Annotator Jobs in Charlotte

Rex.zone; Charlotte (NC); Remote; USD 36,000 - 60,000; Full time

Job summary

Rex.zone is seeking a Remote Data Annotator to label and review NLP, image, and multimodal content from a Charlotte-based remote setup. You will follow strict annotation guidelines to support AI/ML training pipelines and improve data quality.

The role involves RLHF-related tasks, prompt evaluation, and QA audits to ensure accuracy and compliance with safety and quality standards. This position offers a fully remote, high-throughput work environment with opportunities to contribute across

Qualifications

• Mid-Senior experience in data annotation, data labeling, QA evaluation, or AI data operations.
• Strong written reasoning skills using rubrics and annotation guidelines.
• Familiarity with RLHF concepts and large language model evaluation methods.
• Comfort working independently in a remote, high-throughput environment.

Responsibilities

• Deliver accurate data annotation and data labeling across NLP and multimodal datasets.
• Execute RLHF workflows including preference ranking, rubric-based scoring, and rationales.
• Perform prompt evaluation and response grading for safety, factuality, and instruction-following.
• Conduct QA evaluation by auditing samples, identifying recurring errors, and escalating guideline gaps.
• Maintain annotation guidelines compliance and document edge cases clearly.

Job description

Remote Data Annotator Jobs in Charlotte (US Remote)

Join Rex.zone to create high-quality training data for real-world AI/ML and LLM training pipelines. You will label, rate, and review text, image, and multimodal content while following strict annotation guidelines and contributing to training data quality improvements.

Join Rex.zone to create high-quality training data for real-world AI/ML and LLM training pipelines. You will label, rate, and review text, image, and multimodal content while following strict annotation guidelines and contributing to training data quality improvements.

Key Responsibilities

• Deliver accurate data annotation and data labeling across NLP and multimodal datasets
• Execute RLHF workflows including preference ranking, rubric-based scoring, and rationales
• Perform prompt evaluation and response grading for safety, factuality, and instruction-following
• Conduct QA evaluation by auditing samples, identifying recurring errors, and escalating guideline gaps
• Maintain annotation guidelines compliance and document edge cases clearly

What You Will Annotate

• NLP labeling: classification, intent, sentiment, toxicity, summarization quality, named entity recognition
• LLM evaluation: prompt evaluation, RLHF preference ranking, helpfulness/truthfulness/safety rubric scoring
• Computer vision annotation (project-dependent): bounding boxes, polygons, attributes, image QA
• Content safety labeling: policy-based categorization for sensitive or regulated content

Required Qualifications

• Mid-Senior experience in data annotation, data labeling, QA evaluation, or AI data operations
• Strong written reasoning skills using rubrics and annotation guidelines
• Familiarity with RLHF concepts and large language model evaluation methods
• Comfort working independently in a remote, high-throughput environment