Remote AI Data Engineer: QA, Labeling & ML Evaluation

Rex.zone; United States; On-site; USD 80,000 - 120,000; Full time

Job summary

Rex.zone is looking for a full-time remote engineer to support AI/ML workflows by improving training data quality and compliance. Responsibilities include designing QA evaluation checks, implementing data pipelines for labeled datasets, and ensuring adherence to annotation guidelines. Ideal candidates will have a STEM degree and mid-senior level experience in software or data-centric workflows. This role offers a collaborative written-first environment, making it essential for applicants to highlight any engineering delivery and AI/ML evaluation experience.

Qualifications

• Mid-senior experience delivering production-quality work.
• Ability to follow and improve detailed rubrics.
• Familiar with evaluation methods for AI/ML model performance.

Responsibilities

• Design and execute workflow checks for QA evaluation.
• Implement or improve data pipelines for labeled datasets.
• Perform RLHF preference ranking and rubric-based prompt evaluation.
• Validate annotation guidelines compliance via sampling.
• Support NLP labeling such as named entity recognition.
• Execute content safety labeling with consistent documentation.

Skills

Data pipelines implementation

QA evaluation and audits

NLP labeling

AI/ML concepts familiarity

Education

STEM degree or equivalent

Job description

Rex.zone is looking for a full-time remote engineer to support AI/ML workflows by improving training data quality and compliance. Responsibilities include designing QA evaluation checks, implementing data pipelines for labeled datasets, and ensuring adherence to annotation guidelines. Ideal candidates will have a STEM degree and mid-senior level experience in software or data-centric workflows. This role offers a collaborative written-first environment, making it essential for applicants to highlight any engineering delivery and AI/ML evaluation experience.