Lisbon-Based Portuguese AI Data Evaluator (14-Salary)

CloserHire; Lisboa; On-site; EUR 12,000 - 14,000; Full time

Benefits offered by this job

On-site in Lisbon

Private health insurance

Meal allowance

Job summary

CloserHire is hiring in Lisbon for an AI annotation role focused on reviewing and evaluating AI-generated responses. The job requires applying detailed guidelines, labeling outputs for accuracy, and ensuring compliance with safety and quality standards.

Collaborate with international teams, maintain confidentiality, and contribute to ongoing training of advanced AI systems. Expect a structured onboarding process and professional development within a multicultural environment in Lisbon.

Qualifications

• Ability to interpret and apply complex guidelines and policies.
• Excellent analytical thinking and attention to detail.
• Labeling, Trust & Safety, or similar analytical roles desirable.
• Fine-Tuning (SFT), Quality Assurance, Content.
• Feedback (RLHF), Supervised.
• Experience in AI data annotation and LLM evaluation.

Responsibilities

• Review and evaluate AI-generated responses using annotation guidelines.
• Label and annotate outputs for accuracy and consistency.
• Assess content for quality, relevance, factual accuracy, safety, and policy compliance.
• Apply annotation guidelines across varied scenarios.
• Identify inconsistencies and edge cases, escalating when needed.
• Maintain confidentiality and comply with security standards.
• Support model improvement through detailed evaluations and feedback.

Skills

Analytical thinking

Attention to detail

AI data annotation

LLM evaluation

RLHF feedback

Job description

CloserHire is hiring in Lisbon for an AI annotation role focused on reviewing and evaluating AI-generated responses. The job requires applying detailed guidelines, labeling outputs for accuracy, and ensuring compliance with safety and quality standards.

Collaborate with international teams, maintain confidentiality, and contribute to ongoing training of advanced AI systems. Expect a structured onboarding process and professional development within a multicultural environment in Lisbon.