Remote AI/ML Data Operations Engineer — RLHF & Labeling

Rex.zone; United States; Remote; USD 41,328 - 68,880; Part time

Job summary

A technology company focused on AI is seeking an engineer for remote STEM jobs. The role involves designing annotation workflows, implementing evaluation protocols, and maintaining quality standards for large language models and training datasets. Candidates should have a mid-senior STEM background and strong Python abilities. This position offers competitive compensation of $30–$50 per hour. Apply through the company's website highlighting relevant engineering impact and experience in data labeling, QA evaluation, and compliance with guidelines.

Qualifications

• Strong Python skills; comfort with structured and unstructured data.
• Practical understanding of LLM evaluation, data labeling, and QA evaluation concepts.
• Ability to interpret guidelines, resolve ambiguity, and communicate asynchronously in a remote setting.

Responsibilities

• Design and execute annotation and evaluation workflows for NLP, computer vision, and multimodal tasks.
• Implement RLHF and prompt evaluation protocols using well-defined rubrics.
• Define and enforce annotation guidelines compliance; maintain edge-case documentation.

Skills

Python skills

NLP tasks

Data labeling

Quality assurance

Education

Mid-senior STEM/engineering background (CS, EE, math, physics, statistics)

Job description

A technology company focused on AI is seeking an engineer for remote STEM jobs. The role involves designing annotation workflows, implementing evaluation protocols, and maintaining quality standards for large language models and training datasets. Candidates should have a mid-senior STEM background and strong Python abilities. This position offers competitive compensation of $30–$50 per hour. Apply through the company's website highlighting relevant engineering impact and experience in data labeling, QA evaluation, and compliance with guidelines.