Senior Data Annotator - Remote RLHF & Multimodal QA Lead

Rex.zone; Greater London; On-site; GBP 30,706 - 51,177; Full time

Job summary

Rex.zone is seeking a Senior Data Annotator (Remote, Full-time) to lead data annotation workstreams for AI/ML systems. You will generate gold-standard labels, RLHF preferences, and QA outputs across NLP, computer vision, and safety workflows.

Responsibilities include building labeling taxonomies, conducting RLHF comparisons, and ensuring high-quality annotations with thorough QA and edge-case definitions. This role requires independent remote work, strong writing, and meticulous attention to

Qualifications

• Experience in data annotation and labeling for AI/ML systems.
• Familiarity with RLHF and rubric-based evaluation.
• Strong writing and reasoning for evaluating prompts.
• Attention to detail and ability to work independently in remote settings.

Responsibilities

• Execute and review text, image, and multimodal annotation tasks.
• Create labeling taxonomies, edge-case definitions, and rubrics.
• Perform RLHF ranking, pairwise comparisons, and rubric-based scoring.
• Run QA evaluations, audits, and inter-annotator reliability checks.
• Conduct prompt evaluation for instruction-following and safety.
• Label NER datasets and define entity linking rules.
• Contribute to content safety labeling and policy compliance.
• Maintain guidelines changelogs and documentation.
• Collaborate with engineering to improve tooling and throughput.

Skills

Data labeling

RLHF workflows

LLM evaluation

Remote work

Job description

Rex.zone is seeking a Senior Data Annotator (Remote, Full-time) to lead data annotation workstreams for AI/ML systems. You will generate gold-standard labels, RLHF preferences, and QA outputs across NLP, computer vision, and safety workflows.

Responsibilities include building labeling taxonomies, conducting RLHF comparisons, and ensuring high-quality annotations with thorough QA and edge-case definitions. This role requires independent remote work, strong writing, and meticulous attention to