AI Labeling & Evaluation Agent (English-Speaking)

Concentrix; Lisboa; Presencial; EUR 22 000 - 32 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Competitive salary

Fully paid training

Learning & Leadership Development

Resumo da oferta

Concentrix in Lisbon, Portugal is hiring an AI Labeling & Evaluation Agent (English-Speaking) to join our on-site team. You will evaluate AI-generated outputs against detailed guidelines and apply precise annotations to improve language models.

Ideal candidates are fluent in English (C1), with experience in data annotation or AI quality tasks, strong attention to detail, and the ability to interpret complex guidelines.

Qualificações

• Fluent in English with C1 level, strong written skills.
• Experience in AI data annotation, LLM evaluation, or related roles.
• Strong analytical thinking and attention to detail.
• Ability to interpret complex guidelines and apply them consistently.
• Familiar with Generative AI, LLMs, and annotation platforms.

Responsabilidades

• Evaluate AI outputs according to detailed quality guidelines.
• Produce accurate and consistent labels for language model outputs.
• Assess content for quality, relevance, factual accuracy, safety, and policy compliance.
• Apply complex annotation guidelines across diverse scenarios.
• Identify inconsistencies and edge cases, escalating when appropriate.
• Ensure high-quality output while meeting productivity and quality targets.
• Work with structured text, language data, and AI-generated content.
• Maintain confidentiality and comply with project standards and quality requirements.
• Contribute to the continuous improvement of AI systems through accurate evaluations and feedback.

Conhecimentos

English (C1)

AI data annotation

LLM evaluation

Quality Assurance

Content labeling

Descrição da oferta de emprego

Overview

AI Labeling & Evaluation Agent (English-Speaking) – Lisbon, Portugal (On-site)

Experience the power of a game-changing career! We are a global technology and services leader that powers the brands of the future. We help well-known brands—the ones you use every day—improve their businesses with technology and integrated solutions across more than 70 countries.

If you're looking to grow and be inspired, as a Labeling & Evaluation Agent in Lisbon, Portugal (On-site), you will contribute to the development and improvement of cutting-edge Artificial Intelligence systems. You will evaluate AI-generated outputs, apply detailed guidelines, and ensure high-quality annotations that help improve the accuracy, safety, and performance of Large Language Models (LLMs).

Career growth and personal development

We will give you all the training, cutting-edge technologies, and ongoing support you will need to succeed. At Concentrix, there is real career and personal growth potential. Around 80% of our managers and leaders have been promoted from within.

Responsibilities

• Evaluate AI-generated responses according to detailed quality guidelines.
• Produce accurate and consistent labels for language model outputs.
• Assess content for quality, relevance, factual accuracy, safety, and policy compliance.
• Apply complex annotation guidelines across diverse scenarios.
• Identify inconsistencies and edge cases, escalating when appropriate.
• Ensure high-quality output while meeting productivity and quality targets.
• Work with structured text, language data, and AI-generated content.
• Maintain confidentiality and comply with project standards and quality requirements.
• Contribute to the continuous improvement of AI systems through accurate evaluations and feedback.

Qualifications

• Are fluent, verbal and written in English (C1)
• Have experience in AI data annotation, LLM evaluation, RLHF, SFT, Quality Assurance, Content Labeling, Trust & Safety, or similar analytical roles.
• Demonstrate strong analytical thinking, excellent attention to detail, and objective decision-making skills.
• Can accurately interpret and consistently apply complex written guidelines.
• Have excellent written language comprehension and are comfortable working with structured text, datasets, and text-based evaluation tasks.
• Are familiar with Generative AI technologies, Large Language Models (LLMs), and annotation platforms.
• Are available to work rotating shifts, if required.

If you don\'t meet every requirement, we still encourage you to apply.

Benefits

• Competitive salary
• Fully paid training and continuous learning opportunities
• Gain hands-on experience with Generative AI and data annotation technologies
• Career development opportunities within a global technology leader
• Access to free Learning & Leadership Development programmes
• International and multicultural environment
• Central office location in Lisbon
• Bring-a-friend referral bonus

Experience the best version of you!

Concentrix is an equal-opportunity employer. We\'re proudly united as one team, one company, globally. We\'re committed to equal employment opportunities for all candidates and a work environment free from discrimination and harassment. All our recruitment practices are based on business needs, job requirements, and professional qualifications, without regard to race, age, gender identity, sexual orientation, religion, ethnicity, family or parental status, national origin, disability, or any other classification protected by applicable national laws.

Eligibility to work

In accordance with Portuguese law, only applicants who are legally authorized to work in Portugal will be considered for this position.