Remote AI Data Labeling & QA Specialist

Rex.zone; United States; On-site; USD 41,328 - 68,880; Full time

Job summary

Rex.zone is seeking an experienced individual for AI data operations focusing on data labeling and model evaluation. You will be responsible for training data quality checks, QA evaluations, and ongoing improvements for LLM training pipelines. A strong background in AI data operations with 3+ years of experience is required. Compensation is competitive, ranging from $30 to $50 per hour based on experience and project fit. The position is remote, located in the United States.

Qualifications

• 3+ years in AI data operations, data labeling, QA, or model evaluation.
• Experience with RLHF-style preference data or prompt evaluation workflows.
• Strong attention to detail and ability to apply rubrics consistently.

Responsibilities

• Follow annotation guidelines and document edge cases clearly.
• Perform QA evaluation, resolve disagreements, and calibrate with reviewers.
• Provide structured feedback on prompts, rubrics, and evaluation metrics.

Skills

Attention to detail

Rubric application

NLP concepts familiarity

Communication skills

Job description

Rex.zone is seeking an experienced individual for AI data operations focusing on data labeling and model evaluation. You will be responsible for training data quality checks, QA evaluations, and ongoing improvements for LLM training pipelines. A strong background in AI data operations with 3+ years of experience is required. Compensation is competitive, ranging from $30 to $50 per hour based on experience and project fit. The position is remote, located in the United States.