Italian AI Evaluation & Annotation Reviewer

Dorado; United States; Remote; USD 19,286 - 24,796; Full time

Job summary

Dorado seeks language professionals for an AI Evaluation & Annotation Reviewer role, committing to at least six months as an independent contractor with eight-hour shifts and core hours 8:00 AM–5:00 PM PST. You’ll review AI responses, annotate language data, and provide structured feedback while collaborating with QA Leads and clients.

Ideal candidates have Italian fluency, a relevant degree, and interest in AI and language technology.

Qualifications

• Professional fluency in Italian with strong written and verbal communication skills.
• Bachelor’s degree in Linguistics, Languages, Computer Science, or related field, or equivalent professional experience.
• A degree or certification in Italian, where required.
• Strong analytical skills and exceptional attention to detail.
• Experience in annotation, evaluation, translation, localization, linguistics, research, education, or quality assurance is helpful but not required.
• An interest in Artificial Intelligence, Machine Learning, language technology, or data annotation.
• The ability to learn new tools, follow detailed guidelines, and adapt to changing project requirements.
• Strong organization and task‑management skills.
• Professional communication skills and confidence participating in client‑facing meetings.
• The ability to work independently and collaborate effectively with a global team.

Responsibilities

• Review AI-generated responses for clarity, accuracy, correctness, relevance, and overall quality.
• Annotate and label language content according to detailed project guidelines.
• Generate or evaluate prompts based on assignment requirements.
• Identify linguistic errors, dataset concerns, and structural inconsistencies.
• Provide clear, structured feedback to support improvements in AI performance.
• Communicate complex language requirements clearly to both linguistic and non‑linguistic stakeholders.
• Collaborate with QA Leads and clients to apply feedback and maintain quality standards.
• Participate in required client‑facing meetings with your camera on.
• Submit daily work reports and consistently meet productivity and quality expectations.

Skills

Italian fluency

Linguistics degree

Education

Bachelor's degree in Linguistics or related field

Job description

Dorado seeks language professionals for an AI Evaluation & Annotation Reviewer role, committing to at least six months as an independent contractor with eight-hour shifts and core hours 8:00 AM–5:00 PM PST. You’ll review AI responses, annotate language data, and provide structured feedback while collaborating with QA Leads and clients.

Ideal candidates have Italian fluency, a relevant degree, and interest in AI and language technology.