AI Data Labeling & RLHF QA Specialist (Remote)

Rex.zone; United States; Remote; USD 41,328 - 68,880; Full time

Job summary

A tech company specializing in AI solutions is searching for a remote, full-time candidate to support AI/ML training workflows. In this role, you will perform high-accuracy data labeling, execute RLHF evaluation, and ensure training data quality. Candidates should have mid-senior experience in evaluation or data annotation, familiarity with NLP concepts, and strong communication skills. Compensation ranges from $30 to $50 per hour depending on experience.

Qualifications

• Mid-Senior experience in evaluation or annotation programs.
• Strong consistency applying detailed rubrics with low error rates.
• Familiarity with LLM training pipelines and preference-based grading.

Responsibilities

• Perform high-accuracy data labeling for text, image, and multimodal datasets.
• Execute RLHF evaluation and rubric-based scoring.
• Maintain annotation guidelines compliance.

Skills

Evaluation experience

Data annotation

Attention to detail

NLP knowledge

Job description

A tech company specializing in AI solutions is searching for a remote, full-time candidate to support AI/ML training workflows. In this role, you will perform high-accuracy data labeling, execute RLHF evaluation, and ensure training data quality. Candidates should have mid-senior experience in evaluation or data annotation, familiarity with NLP concepts, and strong communication skills. Compensation ranges from $30 to $50 per hour depending on experience.