Portuguese-Speaking AI Data Evaluation – Lisbon, Portugal

CloserHire; Lisboa; Presencial; EUR 12 000 - 14 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

On-site in Lisbon

Private health insurance

Meal allowance

Resumo da oferta

CloserHire is hiring in Lisbon for an AI annotation role focused on reviewing and evaluating AI-generated responses. The job requires applying detailed guidelines, labeling outputs for accuracy, and ensuring compliance with safety and quality standards.

Collaborate with international teams, maintain confidentiality, and contribute to ongoing training of advanced AI systems. Expect a structured onboarding process and professional development within a multicultural environment in Lisbon.

Qualificações

• Ability to interpret and apply complex guidelines and policies.
• Excellent analytical thinking and attention to detail.
• Labeling, Trust & Safety, or similar analytical roles desirable.
• Fine-Tuning (SFT), Quality Assurance, Content.
• Feedback (RLHF), Supervised.
• Experience in AI data annotation and LLM evaluation.

Responsabilidades

• Review and evaluate AI-generated responses using annotation guidelines.
• Label and annotate outputs for accuracy and consistency.
• Assess content for quality, relevance, factual accuracy, safety, and policy compliance.
• Apply annotation guidelines across varied scenarios.
• Identify inconsistencies and edge cases, escalating when needed.
• Maintain confidentiality and comply with security standards.
• Support model improvement through detailed evaluations and feedback.

Conhecimentos

Analytical thinking

Attention to detail

AI data annotation

LLM evaluation

RLHF feedback

Descrição da oferta de emprego

Move to Lisbon and get paid properly for your Portuguese. 920€ x 14 + 100€ Complexity Bonus paid in.

What the job actually involves

Day to day you will be review and evaluate AI-generated responses using detailed annotation and quality guidelines, label and annotate language model outputs with accuracy and consistency, assess AI-generated content for quality, relevance, factual accuracy, safety, and policy compliance, apply complex annotation guidelines across a wide variety of scenarios and content types, identify inconsistencies, edge cases, and potential model issues, escalating when appropriate, analyze structured text, datasets, and AI-generated content to support model improvement, and deliver high-quality work while consistently meeting productivity, quality, and accuracy targets.

You will also handle maintain strict confidentiality and comply with all project standards, security requirements, and internal procedures, and contribute directly to the ongoing training and improvement of advanced AI systems through detailed evaluations and feedback 24/7 rotating schedule (Monday to Sunday) with 2 rotational days off.

What you'll earn

920€ x 14 + 100€ Complexity Bonus paid in

Portuguese contracts pay 14 salaries a year — your normal monthly salary plus a holiday and a Christmas salary. The annual figure is therefore well above monthly × 12, which is worth doing the maths on before you compare it to an offer at home.

What's included

The package covers office-based position in Lisbon, Portugal, comprehensive onboarding and specialized training in AI evaluation processes, opportunity to work on one of the world’s most advanced artificial intelligence projects, international and multicultural working environment, career development opportunities within the rapidly growing AI industry, private health insurance Meal allowance, ongoing learning and professional development, and modern office facilities with a collaborative team culture.

Who this suits

• Ability to interpret and consistently apply complex written guidelines and policies
• Excellent analytical thinking and attention to detail
• Labeling, Trust & Safety, or similar analytical roles is highly desirable
• Fine-Tuning (SFT), Quality Assurance, Content
• Feedback (RLHF), Supervised
• Previous experience in AI data annotation, LLM evaluation, Reinforcement Learning from Human
• Models (LLMs), and AI evaluation methodologies

Living in Portugal

Low living costs, 300-plus days of sun, and big international communities in Lisbon and Porto. No visa needed if you hold an EU passport.

Next steps

Expect roughly five weeks between applying and your first day in country.

CloserHire recruits for this role on behalf of our client. We are an equal-opportunity recruiter and consider every applicant on ability alone.