Remote AI/ML Data Annotation & Evaluation Engineer

Rex.zone; United States; On-site; USD 41,328 - 68,880; Full time

Job summary

Rex.zone is looking for a remote, full-time role in the United States focused on developing high-quality annotation workflows for AI/ML. Responsibilities include owning training data quality metrics, designing labeling schemas, and implementing QA evaluation programs. The candidate should have over 3 years of experience in data operations or related fields and a robust understanding of NLP, LLM evaluation, and human feedback signals. The compensation ranges from $30 to $50 per hour.

Qualifications

• 3+ years in data operations, ML ops, evaluation, or annotation engineering.
• Strong understanding of NLP, LLM evaluation, and human feedback signals.
• Experience with QA evaluation methods and workflow automation.

Responsibilities

• Own training data quality metrics and improvement plans.
• Design labeling schemas and write annotation guidelines.
• Implement QA evaluation programs and perform RLHF preference labeling.

Skills

Data operations

ML ops

NLP

Evaluation methods

Technical writing

Job description

Rex.zone is looking for a remote, full-time role in the United States focused on developing high-quality annotation workflows for AI/ML. Responsibilities include owning training data quality metrics, designing labeling schemas, and implementing QA evaluation programs. The candidate should have over 3 years of experience in data operations or related fields and a robust understanding of NLP, LLM evaluation, and human feedback signals. The compensation ranges from $30 to $50 per hour.