Lisbon-based Russian-Speaking AI Labeling & Evaluation Agent

Ocupacao; United States; Remote; USD 25,000 - 31,000; Full time

Benefits offered by this job

Competitive salary

Fully paid training

Hands-on with Generative AI

Career development opportunities

Learning & Leadership Development

International environment

Central office in Lisbon

Bring-a-friend referral bonus

Job summary

Concentrix is hiring an AI Labeling & Evaluation Agent (Russian-Speaking) to join our Lisbon-based, on-site team. You will evaluate AI outputs, apply detailed guidelines, and produce high-quality annotations to improve safety, accuracy, and performance of large language models.

The role offers full training and ongoing development opportunities. You will work in an international, multicultural environment at our central Lisbon office, with potential rotation shifts and strong career growth

Qualifications

• Fluent Russian (C1) and good English (B2)
• Experience in AI data annotation or LLM evaluation roles
• Strong analytical thinking and attention to detail
• Ability to interpret complex guidelines and apply them consistently
• Familiarity with generative AI, LLMs and annotation platforms

Responsibilities

• Evaluate AI-generated responses according to detailed quality guidelines.
• Produce accurate and consistent labels for language model outputs.
• Assess content for quality, relevance, factual accuracy, safety, and policy compliance.
• Apply complex annotation guidelines across diverse scenarios.
• Identify inconsistencies and edge cases, escalating when appropriate.
• Contribute to continuous improvement of AI systems through evaluations and feedback.

Skills

Russian (C1)

English (B2)

AI data annotation

LLM evaluation

Quality Assurance

Content Labeling

Trust & Safety

Analytical thinking

Attention to detail

Annotation platforms

Tools

Annotation platforms

Job description

Concentrix is hiring an AI Labeling & Evaluation Agent (Russian-Speaking) to join our Lisbon-based, on-site team. You will evaluate AI outputs, apply detailed guidelines, and produce high-quality annotations to improve safety, accuracy, and performance of large language models.

The role offers full training and ongoing development opportunities. You will work in an international, multicultural environment at our central Lisbon office, with potential rotation shifts and strong career growth