RLHF Data Labeling Specialist (Remote, Full-Time)

Rex.zone; United States; On-site; USD 41,328 - 68,880; Full time

Job summary

Rex.zone is seeking an experienced AI Trainer to evaluate and refine model outputs, produce labeled data, and provide feedback in LLM training pipelines. Key responsibilities include executing prompt evaluations, conducting QA evaluations, and identifying failure patterns. The ideal candidate will have mid-senior experience in AI training and data labeling, with strong communication skills. This remote role offers competitive hourly pay ranging from $30 to $50 per hour and is available across the United States.

Qualifications

• Mid-Senior experience in AI training, data labeling, QA evaluation, or LLM evaluation.
• Strong written communication skills and consistent rubric application.
• High attention to detail and ability to maintain audit-ready documentation.
• Comfort with feedback and meeting throughput targets.

Responsibilities

• Perform RLHF-style ranking and preference judgments.
• Execute prompt evaluation and response grading.
• Create and validate labeled datasets for NLP tasks.
• Conduct QA evaluation for adherence to guidelines.
• Identify systematic failure patterns and report insights.
• Support content safety labeling for sensitive topics.
• Collaborate to refine evaluation frameworks.

Skills

AI training

Data labeling

QA evaluation

LLM evaluation

Written communication

Job description

Rex.zone is seeking an experienced AI Trainer to evaluate and refine model outputs, produce labeled data, and provide feedback in LLM training pipelines. Key responsibilities include executing prompt evaluations, conducting QA evaluations, and identifying failure patterns. The ideal candidate will have mid-senior experience in AI training and data labeling, with strong communication skills. This remote role offers competitive hourly pay ranging from $30 to $50 per hour and is available across the United States.