Arabic-Speaking AI Data Evaluation Specialist – Lisbon, Portugal

CloserHire; Lisboa; Presencial; EUR 12.000 - 14.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Onboarding program

Private health insurance

Meal allowance

International environment

Career development opportunities

Descripción de la vacante

CloserHire is recruiting an Arabic-speaking AI Data Evaluation Specialist for a Lisbon-based project on advanced AI systems. You will review and improve AI-generated responses, ensure language accuracy, safety, and policy compliance, on a 24/7 rotating schedule with two days off. Relocation support is included.

Ideal candidates are native Arabic speakers with strong English and a solid understanding of AI evaluation methodologies. This role offers a dynamic, international environment in Lisbon.

Formación

• Native Arabic speaker with high-level English proficiency
• Experience with AI data annotation or LLM evaluation is preferred
• Ability to understand and apply complex evaluation guidelines

Responsabilidades

• Review and evaluate AI-generated responses using detailed annotation guidelines
• Label and annotate model outputs for accuracy and consistency
• Assess content for quality, relevance, factual accuracy, safety and policy compliance
• Apply complex annotation guidelines across diverse content scenarios
• Identify inconsistencies and edge cases, escalate when needed
• Analyze structured text and datasets to support model improvement
• Deliver high-quality work meeting productivity, quality, and accuracy targets
• Maintain confidentiality and comply with project standards and security requirements
• Contribute to ongoing training and improvement of AI systems through evaluations and feedback (24/7 rotating schedule)

Conocimientos

Arabic fluency

English B2+

Generative AI / LLMs

AI data annotation

Attention to detail

Guideline interpretation

Descripción del empleo

Arabic-speaking AI Data Evaluation Specialist | Large Language Models — Lisbon, Portugal. 920€ x 14 + 150€ Complexity Bonus paid in. Relocation support included.

At a glance

• Location: Lisbon, Portugal
• Languages: Arabic
• Salary: 920€ x 14 + 150€ Complexity Bonus paid in
• Start: 27/8
• Relocation: supported — details below

About the role

CloserHire is partnering with a leading global customer experience company to recruit Arabic-speaking AI Data Evaluation Specialists for an innovative artificial intelligence project based in Lisbon, Portugal. If you’re passionate about AI, language technology, and data quality, this is a unique opportunity to contribute to the development of next-generation Large Language Models (LLMs). You’ll work with cutting-edge AI systems by reviewing, evaluating, and improving AI-generated responses, helping create safer, more

What you'll do

• Review and evaluate AI-generated responses using detailed annotation and quality guidelines
• Label and annotate language model outputs with accuracy and consistency
• Assess AI-generated content for quality, relevance, factual accuracy, safety, and policy compliance
• Apply complex annotation guidelines across a wide variety of scenarios and content types
• Identify inconsistencies, edge cases, and potential model issues, escalating when appropriate
• Analyze structured text, datasets, and AI-generated content to support model improvement
• Deliver high-quality work while consistently meeting productivity, quality, and accuracy targets
• Maintain strict confidentiality and comply with all project standards, security requirements, and internal procedures
• Contribute directly to the ongoing training and improvement of advanced AI systems through detailed evaluations and feedback 24/7 rotating schedule (Monday to Sunday) with 2 rotational days off

What we're looking for

• Native-level fluency in Arabic
• Good command of English (B2 level or above)
• Strong understanding of Generative AI, Large Language
• Models (LLMs), and AI evaluation methodologies
• Previous experience in AI data annotation, LLM evaluation, Reinforcement Learning from Human
• Feedback (RLHF), Supervised
• Fine-Tuning (SFT), Quality Assurance, Content
• Labeling, Trust & Safety, or similar analytical roles is highly desirable
• Excellent analytical thinking and attention to detail
• Ability to interpret and consistently apply complex written guidelines and policies

Salary

920€ x 14 + 150€ Complexity Bonus paid in

Portuguese contracts pay 14 salaries a year — your normal monthly salary plus a holiday and a Christmas salary. The annual figure is therefore well above monthly × 12, which is worth doing the maths on before you compare it to an offer at home.

Benefits

• Office-based position in Lisbon, Portugal
• Comprehensive onboarding and specialized training in AI evaluation processes
• Opportunity to work on one of the world’s most advanced artificial intelligence projects
• International and multicultural working environment
• Career development opportunities within the rapidly growing AI industry
• Private health insurance Meal allowance
• Ongoing learning and professional development
• Modern office facilities with a collaborative team culture
• Unique opportunity to shape the future of generative AI and language technologies

Why Portugal?

Portugal is the most popular relocation destination we place into, and it earns that. Over 300 days of sun a year, some of the lowest living costs in Western Europe, and a large international community in Lisbon and Porto that makes arriving alone much less daunting. EU citizens need no visa — you can start immediately.

We are an equal-opportunity recruiter and consider every applicant on ability alone.