Arabic AI Data Evaluator for LLMs — Lisbon

Closerhire; Lisboa; On-site; EUR 28,000 - 36,000; Full time

Benefits offered by this job

Private health insurance

Meal allowance

On-site office

Job summary

CloserHire is partnering with a leading global customer experience company to recruit Arabic-speaking AI Data Evaluation Specialists for an innovative AI project based in Lisbon, Portugal. If you're passionate about AI, language technology, and data quality, this is a unique opportunity to contribute to the development of next-generation Large Language Models.

You'll review, evaluate, and improve AI-generated responses, label outputs, and ensure safety, accuracy, and policy compliance across

Qualifications

• Native-level fluency in Arabic.
• Good command of English (B2 level or above).
• Strong understanding of Generative AI, Large Language Models (LLMs), and AI evaluation methodologies.

Responsibilities

• Review and evaluate AI-generated responses using annotation guidelines.
• Label and annotate language model outputs for accuracy and consistency.
• Assess AI-generated content for quality, relevance, factual accuracy, safety, and policy compliance.

Skills

Arabic language

English (B2+)

AI evaluation

Quality assurance

Attention to detail

Policy compliance

Tools

RLHF

SFT

Job description

CloserHire is partnering with a leading global customer experience company to recruit Arabic-speaking AI Data Evaluation Specialists for an innovative AI project based in Lisbon, Portugal. If you're passionate about AI, language technology, and data quality, this is a unique opportunity to contribute to the development of next-generation Large Language Models.

You'll review, evaluate, and improve AI-generated responses, label outputs, and ensure safety, accuracy, and policy compliance across