Remote AI Generalist: LLM Evaluation & Data Labeling

RemoExperts; Italia; Remote; EUR 60,000 - 90,000; Full time

Job summary

Rex.zone is seeking an experienced AI Generalist to work fully remotely from Italy. You will drive LLM evaluation, RLHF processes, and data quality across NLP and computer vision tasks, contributing to cutting-edge AI training pipelines.

The role emphasizes data labeling, prompt evaluation, and strict annotation guidelines, with a focus on delivering high-quality training data for top AI labs and startups in a fast-growing remote environment.

Qualifications

• Mid-senior level experience in artificial intelligence and machine learning pipelines.
• Proven track record in QA evaluation, LLM training pipelines, and data annotation workflows.
• Strong understanding of both NLP and computer vision annotation techniques.

Responsibilities

• Drive large language model evaluation and prompt evaluation to refine outputs.
• Execute high-quality data labeling including named entity recognition and content safety labeling.
• Manage RLHF (Reinforcement Learning from Human Feedback) processes to align models with human intent.
• Ensure strict annotation guidelines compliance to maximize model performance improvement across NLP and computer vision domains.

Skills

AI/ML pipelines

Data labeling

NLP

Computer vision

RLHF

Job description

Rex.zone is seeking an experienced AI Generalist to work fully remotely from Italy. You will drive LLM evaluation, RLHF processes, and data quality across NLP and computer vision tasks, contributing to cutting-edge AI training pipelines.

The role emphasizes data labeling, prompt evaluation, and strict annotation guidelines, with a focus on delivering high-quality training data for top AI labs and startups in a fast-growing remote environment.