Italian Business Analyst - AI Evaluation

Vraify; Deutschland; Remote; EUR 10,000 - 17,000; Part time

Job summary

Vraify is seeking a remote contractor to assess AI-generated responses for quality and personalization. The role begins immediately and runs for 12-16 weeks, with compensation up to $14/hour.

You will evaluate relevance, accuracy, and personalization, compare responses, and provide structured feedback to improve models. Requires Italian and English proficiency, a bachelor’s degree or equivalent, and a Gmail/Google Workspace setup.

Qualifications

• Native-level Italian proficiency and strong professional English.
• At least 2 years of relevant professional experience and a bachelor’s degree or equivalent practical experience.
• Active primary Google Workspace or corporate Gmail account with ~1,000+ emails and regular activity.
• Must reside outside the United States and be willing to use the qualifying primary account and complete consent process.
• Available at least 4 hours per day, up to 40 hours per week, with 4 hours overlap with Pacific Time.
• Reliable computer and internet access, strong analytical judgment, attention to detail, and ability to work independently.

Responsibilities

• Evaluate the quality, relevance, accuracy, and personalization of AI-generated responses.
• Compare AI responses, identify unsupported assumptions or incorrect personalization, and select the stronger UX.
• Provide clear, structured, and well-reasoned feedback to support model improvements.
• Follow evaluation, privacy, consent, confidentiality, and quality guidelines consistently.

Skills

Italian proficiency

Professional English

Independence

Education

Bachelor's degree or equivalent

Tools

Gmail/Google Workspace

Job description

Evaluate the quality and personalization of AI-generated responses using an established business Gmail. This remote contractor assignment starts immediately, runs for 12-16 weeks, and pays up to $14/hour.

What you\'ll do:

• Evaluate whether AI-generated responses are relevant, accurate, helpful, and appropriately personalized.
• Compare AI responses, identify unsupported assumptions or incorrect personalization, and select the stronger user experience.
• Provide clear, structured, and well-reasoned feedback that supports model improvements.
• Follow evaluation, privacy, consent, confidentiality, and quality guidelines consistently.

What we look for:

• Native-level Italian proficiency and strong professional English.
• At least 2 years of relevant professional experience and a bachelor's degree or equivalent practical experience.
• An active primary Google Workspace or corporate Gmail account. A professional inbox predominantly in Italian with approximately 1,000+ emails and regular activity.
• Must currently reside outside the United States and be willing to use the qualifying primary account and complete the required consent process.
• Available at least 4 hours per day, up to 40 hours per week, including 4 hours of overlap with Pacific Time.
• Reliable computer and internet access, strong analytical judgment, attention to detail, and the ability to work independently.