Remote AI Generalist: LLM Evaluation & Data Labeling

Rex.zone; City of Edinburgh; Hybrid; GBP 65,000 - 95,000; Full time

Job summary

Rex.zone is seeking a mid-senior AI Generalist for full-time remote work from Edinburgh. You will perform prompt evaluation, NLP/vision annotation tasks, and RLHF workflows to support AI training pipelines and model evaluation.

Collaborate with global labs and startups to maintain high-quality data labeling, adhere to annotation guidelines, and help drive continuous improvements across Generative AI models.

Qualifications

• Deep understanding of AI/ML evaluation.
• Experience with QA evaluation, data annotation, and RLHF methodologies.
• Strong analytical skills to assess complex LLM outputs.
• Proven track record in technology and engineering sectors.

Responsibilities

• Execute advanced prompt evaluation, named entity recognition, and content safety labeling.
• Collaborate with global AI labs and tech startups to refine NLP and computer vision annotation tasks.
• Ensure annotation guidelines compliance and drive model performance improvement across generative AI models.

Skills

AI/ML eval

QA evaluation

Data annotation

RLHF

Analytical skills

Job description

Rex.zone is seeking a mid-senior AI Generalist for full-time remote work from Edinburgh. You will perform prompt evaluation, NLP/vision annotation tasks, and RLHF workflows to support AI training pipelines and model evaluation.

Collaborate with global labs and startups to maintain high-quality data labeling, adhere to annotation guidelines, and help drive continuous improvements across Generative AI models.