Remote AI Data Labeling Associate

Rex.zone; United States; On-site; USD 50,000 - 70,000; Full time

Job summary

A data operations company is seeking a remote, full-time role to produce and validate training data for large language models. Key responsibilities include accurate data labeling, QA evaluations, prompt evaluations, and maintaining training data quality. The ideal candidate will have strong attention to detail and a familiarity with AI/ML concepts. This position is designed for distributed execution with cloud-based tools, promoting asynchronous collaboration.

Qualifications

• Comfort working with structured rubrics and maintaining guideline compliance.
• Strong attention to detail for QA evaluation and data quality checks.
• Ability to reason about language and intent for NLP tasks.

Responsibilities

• Deliver accurate data labeling aligned to guidelines and project rubrics.
• Perform QA evaluation using checklists for errors and deviations.
• Complete prompt evaluation and RLHF tasks with comparisons and justifications.
• Maintain consistent training data quality and escalate edge cases.
• Track work in project tools and provide well-documented feedback.

Skills

Attention to detail

Reasoning about language and intent

Familiarity with AI/ML concepts

Job description

A data operations company is seeking a remote, full-time role to produce and validate training data for large language models. Key responsibilities include accurate data labeling, QA evaluations, prompt evaluations, and maintaining training data quality. The ideal candidate will have strong attention to detail and a familiarity with AI/ML concepts. This position is designed for distributed execution with cloud-based tools, promoting asynchronous collaboration.