AI Labeling & Evaluation Agent (Russian-Speaking)

Concentrix; United States; Remote; USD 25,000 - 31,000; Full time

Benefits offered by this job

Competitive salary

Fully paid training

Hands-on with Generative AI

Career development opportunities

Learning & Leadership Development

International environment

Central office in Lisbon

Bring-a-friend referral bonus

Job summary

Concentrix is hiring an AI Labeling & Evaluation Agent (Russian-Speaking) to join our Lisbon-based, on-site team. You will evaluate AI outputs, apply detailed guidelines, and produce high-quality annotations to improve safety, accuracy, and performance of large language models.

The role offers full training and ongoing development opportunities. You will work in an international, multicultural environment at our central Lisbon office, with potential rotation shifts and strong career growth

Qualifications

• Fluent Russian (C1) and good English (B2)
• Experience in AI data annotation or LLM evaluation roles
• Strong analytical thinking and attention to detail
• Ability to interpret complex guidelines and apply them consistently
• Familiarity with generative AI, LLMs and annotation platforms

Responsibilities

• Evaluate AI-generated responses according to detailed quality guidelines.
• Produce accurate and consistent labels for language model outputs.
• Assess content for quality, relevance, factual accuracy, safety, and policy compliance.
• Apply complex annotation guidelines across diverse scenarios.
• Identify inconsistencies and edge cases, escalating when appropriate.
• Contribute to continuous improvement of AI systems through evaluations and feedback.

Skills

Russian (C1)

English (B2)

AI data annotation

LLM evaluation

Quality Assurance

Content Labeling

Trust & Safety

Analytical thinking

Attention to detail

Annotation platforms

Tools

Annotation platforms

Job description

AI Labeling & Evaluation Agent (Russian-Speaking)

Job Description

Experience the power of a game-changing career! Are you looking for what's next? We're a global technology and services leader that powers the brands of the future. We help well-known brands - the ones you use every day - improve their businesses with technology and integrated solutions across more than 70 countries. If you're looking to grow and be inspired, as a Labeling & Evaluation Agent in Lisbon, Portugal (On-site), you'll contribute to the development and improvement of cutting-edge Artificial Intelligence systems. You'll evaluate AI-generated outputs, apply detailed guidelines, and ensure high-quality annotations that help improve the accuracy, safety, and performance of Large Language Models (LLMs).

Career growth and personal development

We'll give you all the training, cutting-edge technologies, and ongoing support you'll need to succeed. At Concentrix, there's real career and personal growth potential. Around 80% of our managers and leaders have been promoted from within.

What You Will Do In This Role

• Evaluate AI-generated responses according to detailed quality guidelines.
• Produce accurate and consistent labels for language model outputs.
• Assess content for quality, relevance, factual accuracy, safety, and policy compliance.
• Apply complex annotation guidelines across diverse scenarios.
• Identify inconsistencies and edge cases, escalating when appropriate.
• Ensure high-quality output while meeting productivity and quality targets.
• Work with structured text, language data, and AI-generated content.
• Maintain confidentiality and comply with project standards and quality requirements.
• Contribute to the continuous improvement of AI systems through accurate evaluations and feedback.

Your Qualifications

Concentrix is a great match if you:

• Are fluent, verbal and written in Russian (C1) and have a good command of English (B2).
• Have experience in AI data annotation, LLM evaluation, RLHF, SFT, Quality Assurance, Content Labeling, Trust & Safety, or similar analytical roles.
• Demonstrate strong analytical thinking, excellent attention to detail, and objective decision-making skills.
• Can accurately interpret and consistently apply complex written guidelines.
• Have excellent written language comprehension and are comfortable working with structured text, datasets, and text-based evaluation tasks.
• Are familiar with Generative AI technologies, Large Language Models (LLMs), and annotation platforms.
• Are available to work rotating shifts, if required.
• If you don't meet every requirement, we still encourage you to apply.

What's In It For You

• Competitive salary
• Fully paid training and continuous learning opportunities
• Gain hands-on experience with Generative AI and data annotation technologies
• Career development opportunities within a global technology leader
• Access to free Learning & Leadership Development programmes
• International and multicultural environment
• Central office location in Lisbon
• Bring-a-friend referral bonus

Concentrix is an equal-opportunity employer

We're proudly united as one team, one company, globally. We're committed to equal employment opportunities for all candidates and a work environment free from discrimination and harassment. All our recruitment practices are based on business needs, job requirements, and professional qualifications, without regard to race, age, gender identity, sexual orientation, religion, ethnicity, family or parental status, national origin, disability, or any other classification protected by applicable national laws.

Eligibility to work

In accordance with Portuguese law, only applicants who are legally authorized to work in Portugal will be considered for this position.