Remote AI Data Annotation & Evaluation Specialist

Rex.zone; United States; On-site; USD 41,328 - 68,880; Full time

Job summary

A technology firm specializing in data annotation is seeking a remote AI Data Annotation Specialist. The role involves executing high-quality data labeling and annotation for NLP and computer vision datasets. Ideal candidates will have mid-senior experience, strong written English skills, and familiarity with LLM evaluation concepts. Compensation ranges from $30 to $50 per hour, depending on complexity, and the work environment requires strong QA practices and asynchronous communication.

Qualifications

• Mid-Senior experience delivering high-precision labeling/evaluation work.
• Strong written English and ability to follow complex rubrics.
• Familiarity with LLM evaluation and RLHF concepts.

Responsibilities

• Execute data labeling and annotation for NLP and computer vision datasets.
• Perform RLHF-style preference comparisons and graded rewards.
• Document edge cases and contribute to annotation guidelines updates.

Skills

High-precision labeling/evaluation work

Strong written English

Familiarity with LLM evaluation

Strong QA mindset

Asynchronous communication

Job description

A technology firm specializing in data annotation is seeking a remote AI Data Annotation Specialist. The role involves executing high-quality data labeling and annotation for NLP and computer vision datasets. Ideal candidates will have mid-senior experience, strong written English skills, and familiarity with LLM evaluation concepts. Compensation ranges from $30 to $50 per hour, depending on complexity, and the work environment requires strong QA practices and asynchronous communication.