Italian AI Evaluation & Annotation Reviewer, Level 3

Volga Partners; Northern (KY); Hybrid; USD 19,000 - 25,000; Full time

Job summary

Volga Partners is seeking linguists for a long-term AI evaluation project. As an AI Evaluation & Annotation Reviewer, you will review AI-generated responses, annotate language data, and provide actionable feedback to improve accuracy and reliability.

This remote contractor role requires Italian fluency, 8+ years in localization or AI training, a relevant degree, and the ability to work eight-hour shifts within core PST hours.

Qualifications

• Professional fluency in Italian with strong written and verbal communication skills.
• Minimum 8 years of experience in Localization, AI Training, or a related field.
• Bachelor’s degree in Linguistics, Languages, Computer Science, or a related field, or equivalent professional experience.

Responsibilities

• Review AI-generated responses for clarity, accuracy, correctness, relevance, and overall quality.
• Annotate and label language content according to detailed project guidelines.
• Generate or evaluate prompts based on assignment requirements.
• Identify linguistic errors, dataset concerns, and structural inconsistencies.
• Provide clear, structured feedback to support improvements in AI performance.
• Communicate complex language requirements clearly to both linguistic and non-linguistic stakeholders.
• Collaborate with QA Leads and clients to apply feedback and maintain quality standards.
• Participate in required client-facing meetings with your camera on.
• Submit daily work reports and consistently meet productivity and quality expectations.

Skills

Professional fluency in Italian

Strong written and verbalcommunication

Education

Bachelor’s degree in Linguistics, Languages, Computer Science, or a related field

Job description

Volga Partners is seeking linguists for a long-term AI evaluation project. As an AI Evaluation & Annotation Reviewer, you will review AI-generated responses, annotate language data, and provide actionable feedback to improve accuracy and reliability.

This remote contractor role requires Italian fluency, 8+ years in localization or AI training, a relevant degree, and the ability to work eight-hour shifts within core PST hours.