AI Labeling & Evaluation Agent (Spanish-Speaking)

Concentrix; Lisboa; On-site; EUR 21,000 - 32,000; Full time

Benefits offered by this job

Competitive salary

Paid training

Gen AI experience

Career development

Learning programs

Multicultural environment

Lisbon office

Referral bonus

Job summary

Concentrix in Lisbon, Portugal is seeking a Spanish-speaking AI Labeling & Evaluation Agent to assess AI outputs and apply detailed guidelines, ensuring high-quality annotations for Large Language Models. You will evaluate responses, label data, and ensure safety and accuracy across diverse scenarios.

The role involves working with structured text and annotation platforms, on-site in Lisbon, with training, growth opportunities, and a multicultural team.

Qualifications

• Fluent in Spanish (C1) and good English (B2) proportion.
• Strong analytical thinking and attention to detail.
• Able to interpret and apply complex guidelines.

Responsibilities

• Evaluate AI-generated responses against quality guidelines.
• Produce accurate and consistent labels for model outputs.
• Assess content for quality, relevance, and safety.
• Apply complex annotation guidelines across scenarios.
• Identify inconsistencies and escalate when needed.
• Maintain high output quality while meeting targets.
• Work with structured text and AI-generated content.
• Maintain confidentiality and comply with project standards.
• Provide feedback to improve AI systems.

Skills

Spanish (C1)

English (B2)

Analytical thinking

Attention to detail

Tools

Annotation platforms

Job description

AI Labeling & Evaluation Agent (Spanish-Speaking)

Experience the power of a game-changing career!
Are you looking for what's next? We're a global technology and services leader that powers the brands of the future. We help well-known brands—the ones you use every day—improve their businesses with technology and integrated solutions across more than 70 countries.
If you're looking to grow and be inspired, as a Labeling & Evaluation Agent in Lisbon, Portugal (On-site), you'll contribute to the development and improvement of cutting-edge Artificial Intelligence systems. You'll evaluate AI-generated outputs, apply detailed guidelines, and ensure high-quality annotations that help improve the accuracy, safety, and performance of Large Language Models (LLMs).

Career growth and personal development

We'll give you all the training, cutting-edge technologies, and ongoing support you'll need to succeed. At Concentrix, there’s real career and personal growth potential. Around 80% of our managers and leaders have been promoted from within.

What You Will Do In This Role

• Evaluate AI-generated responses according to detailed quality guidelines.
• Produce accurate and consistent labels for language model outputs.
• Assess content for quality, relevance, factual accuracy, safety, and policy compliance.
• Apply complex annotation guidelines across diverse scenarios.
• Identify inconsistencies and edge cases, escalating when appropriate.
• Ensure high-quality output while meeting productivity and quality targets.
• Work with structured text, language data, and AI-generated content.
• Maintain confidentiality and comply with project standards and quality requirements.
• Contribute to the continuous improvement of AI systems through accurate evaluations and feedback.

Your Qualifications

• Are fluent, verbal and written in Spanish (C1) and have a good command of English (B2).
• Have experience in AI data annotation, LLM evaluation, RLHF, SFT, Quality Assurance, Content Labeling, Trust & Safety, or similar analytical roles.
• Demonstrate strong analytical thinking, excellent attention to detail, and objective decision-making skills.
• Can accurately interpret and consistently apply complex written guidelines.
• Have excellent written language comprehension and are comfortable working with structured text, datasets, and text-based evaluation tasks.
• Are familiar with Generative AI technologies, Large Language Models (LLMs), and annotation platforms.
• Are available to work rotating shifts, if required.If you don't meet every requirement, we still encourage you to apply.

What's In It For You

• Competitive salary
• Fully paid training and continuous learning opportunities
• Gain hands‑on experience with Generative AI and data annotation technologies
• Career development opportunities within a global technology leader
• Access to free Learning & Leadership Development programmes
• International and multicultural environment
• Central office location in Lisbon
• Bring-a-friend referral bonus

Concentrix is an equal-opportunity employer

We're proudly united as one team, one company, globally. We're committed to equal employment opportunities for all candidates and a work environment free from discrimination and harassment. All our recruitment practices are based on business needs, job requirements, and professional qualifications, without regard to race, age, gender identity, sexual orientation, religion, ethnicity, family or parental status, national origin, disability, or any other classification protected by applicable national laws.

Eligibility to work

In accordance with Portuguese law, only applicants who are legally authorized to work in Portugal will be considered for this position.