Remote AI Generalist: LLM Evaluation & Data Labeling

Rex.zone

City of Edinburgh

Hybrid

GBP 65,000 - 95,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Rex.zone is seeking a mid-senior AI Generalist for full-time remote work from Edinburgh. You will perform prompt evaluation, NLP/vision annotation tasks, and RLHF workflows to support AI training pipelines and model evaluation.

Collaborate with global labs and startups to maintain high-quality data labeling, adhere to annotation guidelines, and help drive continuous improvements across Generative AI models.

Qualifications

  • Deep understanding of AI/ML evaluation.
  • Experience with QA evaluation, data annotation, and RLHF methodologies.
  • Strong analytical skills to assess complex LLM outputs.
  • Proven track record in technology and engineering sectors.

Responsibilities

  • Execute advanced prompt evaluation, named entity recognition, and content safety labeling.
  • Collaborate with global AI labs and tech startups to refine NLP and computer vision annotation tasks.
  • Ensure annotation guidelines compliance and drive model performance improvement across generative AI models.

Skills

AI/ML eval
QA evaluation
Data annotation
RLHF
Analytical skills

Job description

Rex.zone is seeking a mid-senior AI Generalist for full-time remote work from Edinburgh. You will perform prompt evaluation, NLP/vision annotation tasks, and RLHF workflows to support AI training pipelines and model evaluation.

Collaborate with global labs and startups to maintain high-quality data labeling, adhere to annotation guidelines, and help drive continuous improvements across Generative AI models.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Data Generalist for LLM Training
Remote AI Data Generalist for LLM Training

Rex.zone • Greater London

Hybrid
GBP 35,000 - 52,000
Remote work
AI Generalist
AI Generalist

Rex.zone • City of Edinburgh

Remote
GBP 65,000 - 95,000
Remote AI Operations & Strategy Generalist
Remote AI Operations & Strategy Generalist

Rex.zone • Greater London

Hybrid
GBP 52,000 - 76,000
Remote AI Operations Generalist — Scale ML Workflows
Remote AI Operations Generalist — Scale ML Workflows

RemoExperts • Greater London

Remote
GBP 40,000 - 68,000
Data Generalist
Data Generalist

Rex.zone • Greater London

Remote
GBP 35,000 - 52,000
Remote work
Business Generalist
Business Generalist

Rex.zone • Greater London

Remote
GBP 52,000 - 76,000
Remote Senior AI LLM Engineer — Fine-Tune & Deploy
Remote Senior AI LLM Engineer — Fine-Tune & Deploy

David Kennedy Recruitment Limited • United Kingdom

Remote
GBP 70,000 - 120,000
Fully remote Europe
B2B collaboration
Paid leave 20 days
+6
Remote AI Solutions Engineer — LLMs & Automation
Remote AI Solutions Engineer — LLMs & Automation

SPManchester • Wigan

Remote
GBP 70,000 - 110,000
High-Impact Projects
Flexible Work Culture
Continuous Learning
+1
Operations Generalist London 2026
Operations Generalist London 2026

RemoExperts • Greater London

Remote
GBP 40,000 - 68,000
English LLM Data Annotator (Remote, Entry level OK, Freelance)
English LLM Data Annotator (Remote, Entry level OK, Freelance)

T-Maxx International • United Kingdom

Remote
GBP 17,000 - 30,000
Flexible hours
Entry-level path into tech
Training and guidance