STEM Degree Jobs in Canada

Rex.zone; United States; On-site; USD 80,000 - 120,000; Full time

Job summary

Rex.zone is looking for a full-time remote engineer to support AI/ML workflows by improving training data quality and compliance. Responsibilities include designing QA evaluation checks, implementing data pipelines for labeled datasets, and ensuring adherence to annotation guidelines. Ideal candidates will have a STEM degree and mid-senior level experience in software or data-centric workflows. This role offers a collaborative written-first environment, making it essential for applicants to highlight any engineering delivery and AI/ML evaluation experience.

Qualifications

• Mid-senior experience delivering production-quality work.
• Ability to follow and improve detailed rubrics.
• Familiar with evaluation methods for AI/ML model performance.

Responsibilities

• Design and execute workflow checks for QA evaluation.
• Implement or improve data pipelines for labeled datasets.
• Perform RLHF preference ranking and rubric-based prompt evaluation.
• Validate annotation guidelines compliance via sampling.
• Support NLP labeling such as named entity recognition.
• Execute content safety labeling with consistent documentation.

Skills

Data pipelines implementation

QA evaluation and audits

NLP labeling

AI/ML concepts familiarity

Education

STEM degree or equivalent

Job description

Overview

Join Rex.zone in a remote, full-time engineering role supporting end-to-end AI/ML workflows that convert raw data into reliable training datasets and evaluation signals for LLM training pipelines. You will help improve training data quality, annotation guidelines compliance, and large language model evaluation outcomes through structured QA evaluation and audits.

Responsibilities

• Design and execute workflow checks for QA evaluation, audit sampling, and calibration agreement
• Implement or improve data pipelines for labeled datasets and dataset versioning
• Perform RLHF preference ranking and rubric-based prompt evaluation
• Validate annotation guidelines compliance via sampling, adjudication, and reviewer feedback loops
• Support NLP labeling such as named entity recognition and text classification
• Support computer vision annotation (boxes, polygons, keypoints, segmentation) as needed
• Execute content safety labeling with consistent taxonomy, escalation, and documentation
• Document edge cases, decisions, and dataset versions for reproducible delivery

Qualifications

• STEM degree or equivalent practical experience
• Mid-senior experience delivering production-quality work in software or data-centric workflows
• Ability to follow and improve detailed rubrics and operate with measurable quality thresholds
• Familiarity with AI/ML concepts and evaluation methods for model performance improvement

Remote Work and Collaboration

This is a Remote, FULL_TIME role with written-first collaboration using specs, tickets, and review feedback loops.

Apply via Rex.zone with a resume highlighting engineering delivery, QA practices, and any AI/ML evaluation or labeling experience.