Polish speaking Customer Support Representative

The lemon Consulting; Lisboa; On-site; EUR 19,000 - 26,000; Full time

Benefits offered by this job

Modern office in city center

Full-time in Lisbon

Meal allowance

Training and guidance

Coaching and mentoring

Health and wellbeing initiatives

International environment

Job summary

The lemon Consulting in Lisbon, Portugal is seeking a Customer Support Representative to review and annotate AI-generated responses, ensuring quality, accuracy and policy compliance in a fast-paced environment. You will work on-site in central Lisbon, use AI annotation platforms, and collaborate with multilingual teams.

Requirements include native Polish, strong English, analytical mindset and careful interpretation of guidelines.

Qualifications

• Native-level proficiency in Polish and excellent written communication
• Good command of English at least B2
• Strong understanding of Generative AI, LLMs, and AI annotation/evaluation platforms
• Experience in AI data annotation, LLM evaluation, RLHF, SFT, Quality Assurance or related analytical environment is desirable
• Excellent analytical and critical thinking with high attention to detail
• Ability to interpret complex guidelines and apply policies consistently

Responsibilities

• Review and evaluate AI-generated responses using detailed quality and annotation guidelines
• Label and annotate language model outputs accurately and consistently
• Assess AI content for quality, relevance, factual accuracy, safety and policy compliance
• Apply complex annotation guidelines across different scenarios and content types
• Identify inconsistencies and escalate potential quality issues
• Review and analyse structured text, language data and AI-generated content
• Maintain high accuracy and quality while meeting productivity targets
• Provide accurate evaluations and actionable feedback to support model improvement
• Maintain confidentiality and follow data security and quality standards
• Adapt to updated guidelines and project requirements

Skills

Polish (native)

English (B2)

AI annotation platforms

AI evaluation

Job description

Position: Customer Support Representative

Location: Lisbon, Portugal

Work model: on-site

Employment type: Full-time

DUTIES AND RESPONSIBILITIES:

• Review and evaluate AI-generated responses using detailed quality and annotation guidelines
• Label and annotate language model outputs accurately and consistently
• Assess AI-generated content for quality, relevance, factual accuracy, safety and policy compliance
• Apply complex annotation guidelines across different scenarios and content types
• Identify inconsistencies, edge cases and potential quality issues and elevate them when required
• Review and analyse structured text, language data and AI-generated content
• Maintain high levels of accuracy and quality while meeting productivity targets
• Provide accurate evaluations, annotations and actionable feedback to support AI model improvement
• Maintain strict confidentiality and follow project, data security and quality standards
• Adapt to updated guidelines, processes and project requirements.

REQUIREMENTS:

• Native-level proficiency in Polish, with excellent written communication skills
• Good command of English (minimum B2 level)
• Strong understanding of Generative AI, Large Language Models (LLMs), and AI annotation or evaluation platforms
• Previous experience in AI data annotation, LLM evaluation, RLHF, SFT, Quality Assurance, Content Labeling, Trust & Safety or a similar analytical environment is highly desirable
• Excellent analytical and critical thinking skills with strong attention to detail
• Ability to make objective and evidence-based decisions
• Ability to interpret and consistently apply complex written guidelines and policies
• Strong reading comprehension and written language skills
• Ability to evaluate structured text, datasets and AI-generated content accurately
• Comfortable working in a fast-paced, quality-driven environment with productivity and accuracy targets
• Professional and reliable approach with strong integrity Ability to handle confidential and sensitive information with discretion.

BENEFITS:

• Modern office in a city center with open spaces, easy to access with public transportation
• Comprehensive initial training and guidance to make sure you're well prepared and comfortable at a new workplace
• Full-time employment in Lisbon
• 24/7 rotational working schedule
• 2 rotational days off
• Opportunity to work in the rapidly developing field of Generative AI and Large Language Models
• International and multicultural working environment
• Support from colleagues with coaching and mentoring opportunities
• Health and Wellbeing initiatives
• Monthly meal allowance