Remote Senior Data Labeling Lead — AI QA & LLM Evaluation

Rex.zone; Atlanta (GA); On-site; USD 40,000 - 65,000; Full time

Job summary

Rex.zone in Atlanta is seeking a Mid-Senior Data Labeling Specialist to lead high-accuracy labeling and AI/ML evaluation work supporting production LLM training pipelines. You will drive data quality through guideline compliance and RLHF-style ranking across NLP, computer vision, and content safety domains.

This role emphasizes meticulous QA, edge-case documentation, and collaboration with AI labs and startups to deliver reliable labeled data and evaluation signals that improve model performance.

Qualifications

• Mid-Senior experience in data labeling with high accuracy and throughput.
• Proven QA evaluation discipline and adherence to guidelines.
• Familiarity with NLP and/or computer vision annotation; comfortable in remote settings.

Responsibilities

• Execute complex annotation tasks with guideline-driven decisions.
• Own training data quality and evaluation through QA processes.
• Document edge cases and improve consistency.
• Write and enforce annotation guidelines and taxonomies.
• Assist calibration sessions and rubric design for LLM evaluation.

Skills

Data labeling

QA evaluation

NLP annotation

Remote work

Job description

Rex.zone in Atlanta is seeking a Mid-Senior Data Labeling Specialist to lead high-accuracy labeling and AI/ML evaluation work supporting production LLM training pipelines. You will drive data quality through guideline compliance and RLHF-style ranking across NLP, computer vision, and content safety domains.

This role emphasizes meticulous QA, edge-case documentation, and collaboration with AI labs and startups to deliver reliable labeled data and evaluation signals that improve model performance.