Remote AI/ML Data Ops Generalist for LLM Training

Rex.zone; United States; On-site; USD 70,000 - 100,000; Full time

Job summary

Rex.zone is seeking a mid-senior AI/ML Data Operations Generalist to support LLM training pipelines through various data-related tasks. Responsibilities include executing data labeling, QA evaluation, and conducting NLP and computer vision tasks. Candidates should have experience in operations or QA, strong proficiency in written English, and be comfortable working remotely. This full-time position promotes async collaboration and is structured to maintain productivity and quality targets.

Qualifications

• Mid-senior experience in operations, QA, or structured review work.
• Strong written English and ability to apply detailed rubrics consistently.
• Familiarity with LLM evaluation concepts is required.
• Comfort working remotely with productivity and quality targets.

Responsibilities

• Execute data labeling and QA evaluation for various tasks.
• Apply RLHF rubrics for preference ranking.
• Perform prompt evaluation and response grading.
• Conduct content safety labeling across policy categories.
• Maintain audit-ready notes and propose guideline improvements.

Skills

Data labeling

Quality assurance (QA)

NLP tasks

Computer vision annotation

English proficiency

Job description

Rex.zone is seeking a mid-senior AI/ML Data Operations Generalist to support LLM training pipelines through various data-related tasks. Responsibilities include executing data labeling, QA evaluation, and conducting NLP and computer vision tasks. Candidates should have experience in operations or QA, strong proficiency in written English, and be comfortable working remotely. This full-time position promotes async collaboration and is structured to maintain productivity and quality targets.