AI Evaluation & Annotation Reviewer (L3 - Advanced Level) - Italian (US)

Volga Partners; United States; On-site; USD 19,000 - 25,000; Full time

Benefits offered by this job

Project-specific training

Hands-on AI project experience

Global collaboration with QA Leads and

Independent contractor with no paid H/

Job summary

RemoteLeads is seeking an experienced Italian localization specialist to review AI-generated responses, annotate language content, and generate or evaluate prompts. You will identify linguistic issues, provide structured feedback, and communicate language requirements to diverse stakeholders.

Join a global team as an independent contractor, with daily client meetings and a focus on quality assurance for AI projects.

Qualifications

• Professional fluency in Italian with strong written and verbal communication skills.
• At least 8 years of experience in localization, AI training, or related field.
• Bachelor’s degree or equivalent professional experience.
• Strong analytical skills and exceptional attention to detail.

Responsibilities

• Review AI-generated responses for clarity, accuracy, correctness, relevance, and quality.
• Annotate and label language content according to detailed guidelines.
• Generate or evaluate prompts based on assignment requirements.
• Identify linguistic errors, dataset concerns, and structural inconsistencies.
• Provide structured feedback to improve AI performance.
• Communicate language requirements to linguistic and non-linguistic stakeholders.
• Collaborate with QA Leads and clients to apply feedback and maintain quality standards.
• Attend daily client-facing meetings with camera on.
• Submit daily work reports and meet productivity targets.

Skills

Analytical thinking

Attention to detail

Independence

Team collaboration

Education

Bachelor's degree in linguistics / languages / CS or related field

Italian degree or certification where required

Job description

Description

• Review AI-generated responses for clarity, accuracy, correctness, relevance, and overall quality.
• Annotate and label language content according to detailed project guidelines.
• Generate or evaluate prompts based on assignment requirements.
• Identify linguistic errors, dataset concerns, and structural inconsistencies.
• Provide structured feedback to improve AI performance.
• Communicate language requirements clearly to linguistic and non-linguistic stakeholders.
• Collaborate with QA Leads and clients to apply feedback and maintain quality standards.
• Attend daily client-facing meetings with camera on.
• Submit daily work reports and meet productivity and quality expectations.

Requirements

• Professional fluency in Italian with strong written and verbal communication skills.
• At least 8 years of experience in localization, AI training, or a related field.
• Bachelor’s degree in linguistics, languages, computer science, or a related field, or equivalent professional experience.
• Italian degree or certification where required.
• Strong analytical skills and exceptional attention to detail.
• Experience identifying language patterns, errors, inconsistencies, and subtle linguistic issues.
• Experience in annotation, evaluation, translation, localization, linguistics, research, education, or quality assurance is preferred.
• Interest in artificial intelligence, machine learning, language technology, or data annotation.
• Ability to learn new tools, follow detailed guidelines, and adapt to changing requirements.
• Ability to work independently and collaborate effectively with a global team.
• Commitment to a minimum six-month engagement with consistent availability.
• Availability for consecutive eight-hour shifts during core hours of 8:00 AM–5:00 PM PST and daily meetings from 10:00 AM–12:00 PM PST.
• Applicants must reside outside the listed restricted countries and territories.

Benefits

• Italian compensation of $14–$18 USD per hour.
• Project-specific training, guidance, and ongoing feedback.
• Hands-on experience on a global artificial intelligence project.
• Opportunities to build skills in AI evaluation, annotation, prompt review, and language quality.
• Collaboration with QA Leads, international teams, and client stakeholders.
• Independent contractor engagement with no paid holidays or paid time off.